2024-05-09T01:26:35.037 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T01:26:35.037 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957 --owner scheduled_pdonnell@teuthology --verbose --name pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} -- /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/orig.config.yaml 2024-05-09T01:26:35.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T01:26:35.186 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957 branch: wip-pdonnell-testing-20240508.183908-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698957' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240508.183908-debug ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.183908-debug sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1722 sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.183908-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlghCLNRezCFQisjCDEPfbkwWRP8BlQI8mZmzw6gPfnM8YiAUsqBPtDcGFHa5hTCZ9XNo/F8stmQDNtJ/hFH20= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXttXMZO3AeT39xUi7ErEDl8F5Bd0zlONzxMs685n4ePoI9ncVgWxtFghdLTAcj3gR2BwWfzlHCHez1URTkQoE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_22:06:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T01:26:35.186 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa; will attempt to use it 2024-05-09T01:26:35.187 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks 2024-05-09T01:26:35.187 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T01:26:35.189 INFO:teuthology.task.internal:Checking packages... 2024-05-09T01:26:35.212 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c9da4049f638c0f84bdd9b4e33c42e86046ac554' 2024-05-09T01:26:35.212 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T01:26:35.213 INFO:teuthology.packaging:ref: None 2024-05-09T01:26:35.213 INFO:teuthology.packaging:tag: None 2024-05-09T01:26:35.213 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.183908-debug 2024-05-09T01:26:35.213 INFO:teuthology.packaging:sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:26:35.213 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240508.183908-debug 2024-05-09T01:26:35.362 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3594.gc9da4049 2024-05-09T01:26:35.364 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T01:26:35.371 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T01:26:35.371 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T01:26:35.383 INFO:teuthology.task.internal:Saving configuration 2024-05-09T01:26:35.403 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T01:26:35.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T01:26:35.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 01:21:32.922021', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlghCLNRezCFQisjCDEPfbkwWRP8BlQI8mZmzw6gPfnM8YiAUsqBPtDcGFHa5hTCZ9XNo/F8stmQDNtJ/hFH20='} 2024-05-09T01:26:35.458 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 01:21:32.920711', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXttXMZO3AeT39xUi7ErEDl8F5Bd0zlONzxMs685n4ePoI9ncVgWxtFghdLTAcj3gR2BwWfzlHCHez1URTkQoE='} 2024-05-09T01:26:35.458 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T01:26:35.464 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-09T01:26:35.464 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-09T01:26:35.464 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T01:26:35.531 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a94380f70>, signals=[15]) 2024-05-09T01:26:35.532 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T01:26:35.538 INFO:teuthology.task.internal:Opening connections... 2024-05-09T01:26:35.538 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:26:35.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:26:35.621 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:26:35.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:26:35.695 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T01:26:35.702 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-05-09T01:26:35.721 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-05-09T01:26:35.721 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T01:26:35.780 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-05-09T01:26:35.781 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T01:26:35.781 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T01:26:35.781 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T01:26:35.781 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-05-09T01:26:35.805 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-05-09T01:26:35.823 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-05-09T01:26:35.823 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-05-09T01:26:35.880 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-05-09T01:26:35.880 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-05-09T01:26:35.880 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-05-09T01:26:35.880 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-05-09T01:26:35.880 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T01:26:35.881 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T01:26:35.881 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-05-09T01:26:35.905 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T01:26:35.915 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T01:26:35.920 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T01:26:35.921 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-05-09T01:26:35.923 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-05-09T01:26:35.939 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T01:26:35.946 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T01:26:35.946 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-05-09T01:26:35.981 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-05-09T01:26:36.021 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T01:26:36.069 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T01:26:36.084 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T01:26:36.084 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T01:26:36.084 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T01:26:36.085 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T01:26:36.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:26:36.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:26:36.102 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-05-09T01:26:36.103 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-05-09T01:26:36.159 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-437.el9.x86_64 2024-05-09T01:26:36.159 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-437.el9.x86_64 2024-05-09T01:26:36.159 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-05-09T01:26:36.160 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-437.el9.x86_64 2024-05-09T01:26:36.161 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-437.el9.x86_64 2024-05-09T01:26:36.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-05-09T01:26:39.615 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.1 MB 00:01 2024-05-09T01:26:42.250 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.1 MB 00:04 2024-05-09T01:26:49.299 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-05-09T01:26:51.825 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-05-09T01:26:55.208 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.2 MB 00:02 2024-05-09T01:26:56.892 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-09T01:26:57.226 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-09T01:26:58.621 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-09T01:26:59.034 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-09T01:27:00.638 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-09T01:27:03.902 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-05-09T01:27:04.115 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:01 ago on Thu 09 May 2024 01:27:03 AM UTC. 2024-05-09T01:27:05.860 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-09T01:27:05.925 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T01:27:05.925 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T01:27:06.015 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-09T01:27:06.024 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-09T01:27:06.024 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-05-09T01:27:06.024 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-05-09T01:27:06.025 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:27:06.026 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 78 M 2024-05-09T01:27:06.026 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 123 M 2024-05-09T01:27:06.026 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-09T01:27:06.312 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.1 MB/s | 484 kB 00:00 2024-05-09T01:27:07.899 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T01:27:07.900 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T01:27:07.997 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:27:08.003 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-05-09T01:27:08.004 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-05-09T01:27:08.004 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-05-09T01:27:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:27:08.004 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 78 M 2024-05-09T01:27:08.004 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 123 M 2024-05-09T01:27:08.004 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-05-09T01:27:08.320 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.5 MB/s | 484 kB 00:00 2024-05-09T01:27:08.754 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 25 MB/s | 15 MB 00:00 2024-05-09T01:27:09.195 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 5.0 MB/s | 15 MB 00:03 2024-05-09T01:27:09.595 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 9.7 MB/s | 34 MB 00:03 2024-05-09T01:27:09.829 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 19 MB/s | 28 MB 00:01 2024-05-09T01:27:09.853 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 7.9 MB/s | 28 MB 00:03 2024-05-09T01:27:09.854 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-09T01:27:09.854 INFO:teuthology.orchestra.run.smithi042.stdout:Total 20 MB/s | 78 MB 00:03 2024-05-09T01:27:10.568 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-09T01:27:10.952 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-09T01:27:10.953 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-09T01:27:11.071 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 12 MB/s | 34 MB 00:02 2024-05-09T01:27:11.071 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-05-09T01:27:11.071 INFO:teuthology.orchestra.run.smithi181.stdout:Total 25 MB/s | 78 MB 00:03 2024-05-09T01:27:11.757 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-05-09T01:27:11.910 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-09T01:27:11.910 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-09T01:27:12.098 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-05-09T01:27:12.099 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-05-09T01:27:13.045 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-05-09T01:27:13.046 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-05-09T01:27:14.462 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-09T01:27:15.113 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T01:27:15.197 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T01:27:15.434 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-05-09T01:27:16.060 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T01:27:16.145 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T01:27:18.005 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T01:27:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T01:27:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T01:27:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T01:27:23.218 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T01:27:23.266 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:23.656 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T01:27:23.749 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:28.362 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:57.926 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:57.964 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T01:27:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T01:27:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:27:59.033 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-05-09T01:27:59.338 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:59.369 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T01:27:59.377 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:59.447 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T01:27:59.447 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T01:27:59.447 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T01:27:59.447 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T01:27:59.447 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T01:27:59.448 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-09T01:27:59.448 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T01:27:59.448 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T01:27:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T01:27:59.498 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T01:27:59.498 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-05-09T01:27:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-05-09T01:27:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-05-09T01:27:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 68.el9 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8264254 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-05-09T01:27:59.531 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:27:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T01:27:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T01:27:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T01:27:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-05-09T01:27:59.532 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:27:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T01:27:59.532 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T01:27:59.532 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-444.el9.x86_64 2024-05-09T01:27:59.532 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T01:27:59.713 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:27:59.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T01:27:59.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T01:27:59.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T01:28:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T01:28:00.548 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T01:28:00.549 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:28:00.549 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-09T01:28:00.912 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T01:28:00.985 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T01:28:00.986 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T01:28:00.986 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T01:28:00.986 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T01:28:00.986 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T01:28:00.986 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T01:28:00.986 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T01:28:00.986 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T01:28:01.037 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T01:28:01.037 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T01:28:01.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-05-09T01:28:01.068 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 68.el9 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8264254 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T01:28:01.069 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:28:01.070 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T01:28:01.071 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T01:28:01.071 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-444.el9.x86_64 2024-05-09T01:28:01.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T01:28:01.666 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T01:28:01.697 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-05-09T01:28:01.699 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-05-09T01:28:01.714 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.NrKw7bdiOf 2024-05-09T01:28:01.715 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NrKw7bdiOf 2024-05-09T01:28:01.716 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-05-09T01:28:01.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.NrKw7bdiOf 2024-05-09T01:28:01.917 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.NrKw7bdiOf is 6KB 2024-05-09T01:28:01.966 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.NrKw7bdiOf 2024-05-09T01:28:01.980 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T01:28:02.041 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T01:28:02.041 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T01:28:02.041 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T01:28:02.041 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T01:28:02.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T01:28:02.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-05-09T01:28:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T01:28:03.180 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-05-09T01:28:03.183 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-09T01:28:03.239 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.QV8ALp0Ojr 2024-05-09T01:28:03.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QV8ALp0Ojr 2024-05-09T01:28:03.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.QV8ALp0Ojr 2024-05-09T01:28:03.444 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.QV8ALp0Ojr is 6KB 2024-05-09T01:28:03.492 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.QV8ALp0Ojr 2024-05-09T01:28:03.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T01:28:03.569 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T01:28:03.569 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T01:28:03.569 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T01:28:03.569 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T01:28:03.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T01:28:03.722 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-05-09T01:28:32.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-09T01:28:32.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-09T01:28:32.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:28:33.726 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T01:28:33.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-09T01:28:33.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:28:50.719 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-09T01:28:52.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-05-09T01:28:59.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-09T01:28:59.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:29:01.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-09T01:29:01.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:29:02.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-09T01:29:14.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-09T01:29:14.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:29:32.954 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-05-09T01:29:33.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-09T01:29:33.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-09T01:29:33.455 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-05-09T01:29:33.472 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-444.el9.x86_64 2024-05-09T01:29:33.472 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T01:29:33.472 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T01:29:33.472 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T01:29:34.473 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T01:29:34.473 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T01:29:34.601 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-05-09T01:29:34.653 DEBUG:teuthology.parallel:result is None 2024-05-09T01:29:46.616 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-05-09T01:29:47.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-09T01:29:47.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-444.el9.x86_64"... 2024-05-09T01:29:47.018 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-05-09T01:29:47.032 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-444.el9.x86_64 2024-05-09T01:29:47.033 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T01:29:47.033 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T01:29:47.033 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T01:29:48.034 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-09T01:29:48.034 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T01:29:48.100 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-05-09T01:29:48.148 DEBUG:teuthology.parallel:result is None 2024-05-09T01:29:48.149 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T01:29:48.156 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T01:29:48.156 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T01:29:48.160 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T01:29:48.178 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T01:29:48.208 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T01:29:48.215 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T01:29:48.216 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T01:29:48.220 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T01:29:48.248 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T01:29:48.255 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T01:29:48.255 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T01:29:48.284 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T01:29:48.315 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T01:29:48.328 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T01:29:48.345 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T01:29:48.355 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T01:29:48.357 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T01:29:48.370 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T01:29:48.370 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T01:29:48.373 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T01:29:48.399 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T01:29:48.408 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T01:29:48.409 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T01:29:48.441 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T01:29:48.456 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T01:29:48.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T01:29:48.590 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T01:29:48.674 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T01:29:48.717 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:29:48.717 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T01:29:48.784 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T01:29:48.826 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T01:29:48.869 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T01:29:48.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T01:29:48.985 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:29:48.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T01:29:49.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-05-09T01:29:49.050 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-05-09T01:29:49.098 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:29:49.148 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:29:49.529 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T01:29:49.537 INFO:teuthology.task.internal:Starting timer... 2024-05-09T01:29:49.537 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T01:29:49.548 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T01:29:49.556 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-09T01:29:49.557 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-05-09T01:29:49.621 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-05-09T01:29:49.623 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-05-09T01:29:49.729 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-05-09T01:29:49.731 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T01:29:49.731 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-05-09T01:29:49.758 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-05-09T01:29:49.758 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-05-09T01:29:49.779 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-05-09T01:29:49.779 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-05-09T01:29:49.779 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:29:49.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:29:49.827 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:29:49.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:29:49.852 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T01:29:49.853 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-05-09T01:29:49.894 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-05-09T01:29:49.920 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T01:29:49.931 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T01:29:49.949 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T01:29:49.950 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T01:33:52.603 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-05-09T01:33:52.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-09T01:33:52.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:33:52.686 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-05-09T01:33:52.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-09T01:33:52.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-09T01:33:52.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T01:33:52.840 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-05-09T01:33:52.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-09T01:33:52.922 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T01:33:52.934 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T01:33:52.934 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T01:33:52.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:33:52.937 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T01:33:52.937 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:33:52.965 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T01:33:52.980 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T01:33:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T01:33:53.005 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T01:33:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-05-09T01:33:53.017 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-05-09T01:33:53.029 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-05-09T01:33:53.032 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T01:33:53.040 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-05-09T01:33:53.046 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T01:33:53.054 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T01:33:53.068 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T01:33:53.103 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:33:53.107 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:33:53.107 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-05-09T01:33:53.107 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.108 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.108 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.108 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.123 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:33:53.127 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:33:53.127 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-05-09T01:33:53.127 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.127 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.127 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.127 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:33:53.128 INFO:teuthology.run_tasks:Running task install... 2024-05-09T01:33:53.136 DEBUG:teuthology.task.install:project ceph 2024-05-09T01:33:53.136 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}} 2024-05-09T01:33:53.137 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'} 2024-05-09T01:33:53.137 INFO:teuthology.task.install:Using flavor: default 2024-05-09T01:33:53.142 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T01:33:53.142 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T01:33:53.142 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T01:33:53.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:33:53.145 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T01:33:53.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:33:53.286 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T01:33:53.286 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T01:33:53.364 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T01:33:53.364 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T01:33:53.398 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T01:33:53.398 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:33:53.398 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T01:33:53.426 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T01:33:53.426 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T01:33:53.492 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T01:33:53.537 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T01:33:53.537 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:33:53.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T01:33:53.564 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T01:33:53.564 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T01:33:53.569 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T01:33:53.630 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T01:33:53.635 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-05-09T01:33:53.637 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-05-09T01:33:53.705 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T01:33:53.769 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-05-09T01:33:53.770 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-05-09T01:33:53.879 INFO:teuthology.orchestra.run.smithi042.stdout:54 files removed 2024-05-09T01:33:53.907 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T01:33:53.998 INFO:teuthology.orchestra.run.smithi181.stdout:54 files removed 2024-05-09T01:33:54.027 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T01:33:54.526 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 254 kB/s | 84 kB 00:00 2024-05-09T01:33:54.702 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 208 kB/s | 84 kB 00:00 2024-05-09T01:33:54.935 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-05-09T01:33:55.152 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-05-09T01:33:55.562 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-05-09T01:33:55.602 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-05-09T01:33:56.328 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-09T01:33:57.627 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.1 MB 00:01 2024-05-09T01:33:59.772 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 19 MB 00:02 2024-05-09T01:34:00.720 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 19 MB 00:01 2024-05-09T01:34:05.004 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-09T01:34:05.338 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:02 2024-05-09T01:34:06.564 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-05-09T01:34:08.665 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-09T01:34:14.191 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-09T01:34:16.636 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T01:34:16.636 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T01:34:16.648 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T01:34:16.648 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T01:34:16.649 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T01:34:16.650 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T01:34:16.652 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T01:34:16.654 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T01:34:16.655 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T01:34:16.720 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-09T01:34:16.740 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-05-09T01:34:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-09T01:34:16.740 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-05-09T01:34:16.740 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T01:34:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T01:34:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T01:34:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T01:34:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T01:34:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T01:34:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T01:34:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T01:34:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T01:34:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T01:34:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T01:34:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T01:34:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T01:34:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T01:34:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout:Install 148 Packages 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 8 Packages 2024-05-09T01:34:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:34:16.758 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 219 M 2024-05-09T01:34:16.758 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-09T01:34:17.309 INFO:teuthology.orchestra.run.smithi042.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-05-09T01:34:17.510 INFO:teuthology.orchestra.run.smithi042.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 4.2 MB/s | 863 kB 00:00 2024-05-09T01:34:17.577 INFO:teuthology.orchestra.run.smithi042.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 2.1 MB/s | 147 kB 00:00 2024-05-09T01:34:17.885 INFO:teuthology.orchestra.run.smithi042.stdout:(4/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 7.3 MB/s | 2.3 MB 00:00 2024-05-09T01:34:18.152 INFO:teuthology.orchestra.run.smithi042.stdout:(5/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 5.6 MB/s | 1.5 MB 00:00 2024-05-09T01:34:18.544 INFO:teuthology.orchestra.run.smithi042.stdout:(6/156): ceph-common-19.0.0-3594.gc9da4049.el9. 14 MB/s | 20 MB 00:01 2024-05-09T01:34:18.703 INFO:teuthology.orchestra.run.smithi042.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 8.9 MB/s | 4.9 MB 00:00 2024-05-09T01:34:19.703 INFO:teuthology.orchestra.run.smithi042.stdout:(8/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x86 15 MB/s | 18 MB 00:01 2024-05-09T01:34:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:(9/156): ceph-radosgw-19.0.0-3594.gc9da4049.el9 8.9 MB/s | 10 MB 00:01 2024-05-09T01:34:19.861 INFO:teuthology.orchestra.run.smithi042.stdout:(10/156): ceph-selinux-19.0.0-3594.gc9da4049.el 159 kB/s | 25 kB 00:00 2024-05-09T01:34:19.912 INFO:teuthology.orchestra.run.smithi042.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 4.4 MB/s | 224 kB 00:00 2024-05-09T01:34:19.971 INFO:teuthology.orchestra.run.smithi042.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 463 kB/s | 27 kB 00:00 2024-05-09T01:34:20.046 INFO:teuthology.orchestra.run.smithi042.stdout:(13/156): ceph-base-19.0.0-3594.gc9da4049.el9.x 1.9 MB/s | 5.4 MB 00:02 2024-05-09T01:34:20.072 INFO:teuthology.orchestra.run.smithi042.stdout:(14/156): libcephfs-devel-19.0.0-3594.gc9da4049 317 kB/s | 32 kB 00:00 2024-05-09T01:34:20.139 INFO:teuthology.orchestra.run.smithi042.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 2.3 MB/s | 158 kB 00:00 2024-05-09T01:34:20.206 INFO:teuthology.orchestra.run.smithi042.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.9 MB/s | 127 kB 00:00 2024-05-09T01:34:20.297 INFO:teuthology.orchestra.run.smithi042.stdout:(17/156): libradosstriper1-19.0.0-3594.gc9da404 5.3 MB/s | 497 kB 00:00 2024-05-09T01:34:20.390 INFO:teuthology.orchestra.run.smithi042.stdout:(18/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 2.2 MB/s | 756 kB 00:00 2024-05-09T01:34:20.481 INFO:teuthology.orchestra.run.smithi042.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 493 kB/s | 45 kB 00:00 2024-05-09T01:34:20.599 INFO:teuthology.orchestra.run.smithi042.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 1.1 MB/s | 135 kB 00:00 2024-05-09T01:34:20.674 INFO:teuthology.orchestra.run.smithi042.stdout:(21/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 14 MB/s | 5.2 MB 00:00 2024-05-09T01:34:20.741 INFO:teuthology.orchestra.run.smithi042.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 4.7 MB/s | 321 kB 00:00 2024-05-09T01:34:20.808 INFO:teuthology.orchestra.run.smithi042.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 4.4 MB/s | 301 kB 00:00 2024-05-09T01:34:20.866 INFO:teuthology.orchestra.run.smithi042.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.7 MB/s | 99 kB 00:00 2024-05-09T01:34:20.925 INFO:teuthology.orchestra.run.smithi042.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.4 MB/s | 86 kB 00:00 2024-05-09T01:34:20.959 INFO:teuthology.orchestra.run.smithi042.stdout:(26/156): python3-cephfs-19.0.0-3594.gc9da4049. 450 kB/s | 162 kB 00:00 2024-05-09T01:34:21.167 INFO:teuthology.orchestra.run.smithi042.stdout:(27/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 13 MB/s | 3.0 MB 00:00 2024-05-09T01:34:21.193 INFO:teuthology.orchestra.run.smithi042.stdout:(28/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 723 kB/s | 169 kB 00:00 2024-05-09T01:34:21.218 INFO:teuthology.orchestra.run.smithi042.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3594.g 681 kB/s | 34 kB 00:00 2024-05-09T01:34:21.276 INFO:teuthology.orchestra.run.smithi042.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.7 MB/s | 142 kB 00:00 2024-05-09T01:34:21.485 INFO:teuthology.orchestra.run.smithi042.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 13 MB/s | 3.5 MB 00:00 2024-05-09T01:34:21.544 INFO:teuthology.orchestra.run.smithi042.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 4.6 MB/s | 274 kB 00:00 2024-05-09T01:34:21.602 INFO:teuthology.orchestra.run.smithi042.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 848 kB/s | 49 kB 00:00 2024-05-09T01:34:21.652 INFO:teuthology.orchestra.run.smithi042.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 329 kB/s | 16 kB 00:00 2024-05-09T01:34:21.720 INFO:teuthology.orchestra.run.smithi042.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 4.0 MB/s | 273 kB 00:00 2024-05-09T01:34:21.820 INFO:teuthology.orchestra.run.smithi042.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 7.5 MB/s | 763 kB 00:00 2024-05-09T01:34:21.870 INFO:teuthology.orchestra.run.smithi042.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 365 kB/s | 18 kB 00:00 2024-05-09T01:34:22.212 INFO:teuthology.orchestra.run.smithi042.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 235 kB/s | 80 kB 00:00 2024-05-09T01:34:22.721 INFO:teuthology.orchestra.run.smithi042.stdout:(39/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 15 MB/s | 43 MB 00:02 2024-05-09T01:34:23.088 INFO:teuthology.orchestra.run.smithi042.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 917 kB/s | 803 kB 00:00 2024-05-09T01:34:23.205 INFO:teuthology.orchestra.run.smithi042.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-05-09T01:34:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 378 kB/s | 195 kB 00:00 2024-05-09T01:34:23.356 INFO:teuthology.orchestra.run.smithi042.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-05-09T01:34:23.481 INFO:teuthology.orchestra.run.smithi042.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 4.5 MB/s | 1.2 MB 00:00 2024-05-09T01:34:23.532 INFO:teuthology.orchestra.run.smithi042.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 771 kB/s | 135 kB 00:00 2024-05-09T01:34:23.590 INFO:teuthology.orchestra.run.smithi042.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-09T01:34:23.632 INFO:teuthology.orchestra.run.smithi042.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-05-09T01:34:23.799 INFO:teuthology.orchestra.run.smithi042.stdout:(48/156): ceph-mgr-diskprediction-local-19.0.0- 2.9 MB/s | 7.4 MB 00:02 2024-05-09T01:34:23.833 INFO:teuthology.orchestra.run.smithi042.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-05-09T01:34:23.891 INFO:teuthology.orchestra.run.smithi042.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-05-09T01:34:23.916 INFO:teuthology.orchestra.run.smithi042.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-05-09T01:34:23.942 INFO:teuthology.orchestra.run.smithi042.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-09T01:34:23.967 INFO:teuthology.orchestra.run.smithi042.stdout:(53/156): boost-program-options-1.75.0-8.el9.x8 638 kB/s | 107 kB 00:00 2024-05-09T01:34:23.992 INFO:teuthology.orchestra.run.smithi042.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 432 kB/s | 33 kB 00:00 2024-05-09T01:34:24.018 INFO:teuthology.orchestra.run.smithi042.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-05-09T01:34:24.043 INFO:teuthology.orchestra.run.smithi042.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-05-09T01:34:24.068 INFO:teuthology.orchestra.run.smithi042.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-09T01:34:24.093 INFO:teuthology.orchestra.run.smithi042.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-05-09T01:34:24.152 INFO:teuthology.orchestra.run.smithi042.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-05-09T01:34:24.219 INFO:teuthology.orchestra.run.smithi042.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-05-09T01:34:24.244 INFO:teuthology.orchestra.run.smithi042.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 277 kB/s | 25 kB 00:00 2024-05-09T01:34:24.270 INFO:teuthology.orchestra.run.smithi042.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-05-09T01:34:24.295 INFO:teuthology.orchestra.run.smithi042.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-09T01:34:24.329 INFO:teuthology.orchestra.run.smithi042.stdout:(64/156): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-05-09T01:34:24.354 INFO:teuthology.orchestra.run.smithi042.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-05-09T01:34:24.379 INFO:teuthology.orchestra.run.smithi042.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-09T01:34:24.455 INFO:teuthology.orchestra.run.smithi042.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-05-09T01:34:24.522 INFO:teuthology.orchestra.run.smithi042.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-05-09T01:34:24.564 INFO:teuthology.orchestra.run.smithi042.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 8.2 MB/s | 911 kB 00:00 2024-05-09T01:34:24.589 INFO:teuthology.orchestra.run.smithi042.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-05-09T01:34:24.648 INFO:teuthology.orchestra.run.smithi042.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-05-09T01:34:24.690 INFO:teuthology.orchestra.run.smithi042.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-05-09T01:34:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:(73/156): openblas-openmp-0.3.21-2.el9.x86_64.r 9.7 MB/s | 4.7 MB 00:00 2024-05-09T01:34:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:(74/156): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-05-09T01:34:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-09T01:34:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-09T01:34:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-05-09T01:34:25.008 INFO:teuthology.orchestra.run.smithi042.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-05-09T01:34:25.025 INFO:teuthology.orchestra.run.smithi042.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-05-09T01:34:25.100 INFO:teuthology.orchestra.run.smithi042.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-05-09T01:34:25.126 INFO:teuthology.orchestra.run.smithi042.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-05-09T01:34:25.168 INFO:teuthology.orchestra.run.smithi042.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-09T01:34:25.193 INFO:teuthology.orchestra.run.smithi042.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-05-09T01:34:25.218 INFO:teuthology.orchestra.run.smithi042.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-09T01:34:25.244 INFO:teuthology.orchestra.run.smithi042.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-05-09T01:34:25.269 INFO:teuthology.orchestra.run.smithi042.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-05-09T01:34:25.294 INFO:teuthology.orchestra.run.smithi042.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-09T01:34:25.328 INFO:teuthology.orchestra.run.smithi042.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-05-09T01:34:25.353 INFO:teuthology.orchestra.run.smithi042.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 868 kB/s | 51 kB 00:00 2024-05-09T01:34:25.420 INFO:teuthology.orchestra.run.smithi042.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-09T01:34:25.445 INFO:teuthology.orchestra.run.smithi042.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 457 kB/s | 54 kB 00:00 2024-05-09T01:34:25.471 INFO:teuthology.orchestra.run.smithi042.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-05-09T01:34:25.513 INFO:teuthology.orchestra.run.smithi042.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-05-09T01:34:25.538 INFO:teuthology.orchestra.run.smithi042.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-05-09T01:34:25.580 INFO:teuthology.orchestra.run.smithi042.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 533 kB/s | 36 kB 00:00 2024-05-09T01:34:25.614 INFO:teuthology.orchestra.run.smithi042.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-05-09T01:34:25.664 INFO:teuthology.orchestra.run.smithi042.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-09T01:34:25.715 INFO:teuthology.orchestra.run.smithi042.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-09T01:34:25.740 INFO:teuthology.orchestra.run.smithi042.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.4 MB/s | 305 kB 00:00 2024-05-09T01:34:25.765 INFO:teuthology.orchestra.run.smithi042.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-09T01:34:25.791 INFO:teuthology.orchestra.run.smithi042.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-05-09T01:34:25.949 INFO:teuthology.orchestra.run.smithi042.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-05-09T01:34:26.274 INFO:teuthology.orchestra.run.smithi042.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-05-09T01:34:26.591 INFO:teuthology.orchestra.run.smithi042.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-05-09T01:34:27.041 INFO:teuthology.orchestra.run.smithi042.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 43 kB/s | 19 kB 00:00 2024-05-09T01:34:27.133 INFO:teuthology.orchestra.run.smithi042.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 360 kB/s | 309 kB 00:00 2024-05-09T01:34:27.242 INFO:teuthology.orchestra.run.smithi042.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-05-09T01:34:27.267 INFO:teuthology.orchestra.run.smithi042.stdout:(108/156): abseil-cpp-20211102.0-3.el9.x86_64.r 416 kB/s | 548 kB 00:01 2024-05-09T01:34:27.343 INFO:teuthology.orchestra.run.smithi042.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-05-09T01:34:27.451 INFO:teuthology.orchestra.run.smithi042.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 366 kB/s | 67 kB 00:00 2024-05-09T01:34:27.618 INFO:teuthology.orchestra.run.smithi042.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 548 kB/s | 151 kB 00:00 2024-05-09T01:34:28.385 INFO:teuthology.orchestra.run.smithi042.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 715 kB/s | 548 kB 00:00 2024-05-09T01:34:28.502 INFO:teuthology.orchestra.run.smithi042.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 372 kB/s | 43 kB 00:00 2024-05-09T01:34:28.536 INFO:teuthology.orchestra.run.smithi042.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 774 kB/s | 839 kB 00:01 2024-05-09T01:34:28.605 INFO:teuthology.orchestra.run.smithi042.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-05-09T01:34:28.644 INFO:teuthology.orchestra.run.smithi042.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-05-09T01:34:28.878 INFO:teuthology.orchestra.run.smithi042.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 624 kB/s | 172 kB 00:00 2024-05-09T01:34:29.162 INFO:teuthology.orchestra.run.smithi042.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 693 kB/s | 358 kB 00:00 2024-05-09T01:34:29.270 INFO:teuthology.orchestra.run.smithi042.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 326 kB/s | 35 kB 00:00 2024-05-09T01:34:29.363 INFO:teuthology.orchestra.run.smithi042.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 626 kB/s | 303 kB 00:00 2024-05-09T01:34:29.638 INFO:teuthology.orchestra.run.smithi042.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 559 kB/s | 206 kB 00:00 2024-05-09T01:34:29.914 INFO:teuthology.orchestra.run.smithi042.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 525 kB/s | 144 kB 00:00 2024-05-09T01:34:30.014 INFO:teuthology.orchestra.run.smithi042.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-05-09T01:34:30.131 INFO:teuthology.orchestra.run.smithi042.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-05-09T01:34:30.240 INFO:teuthology.orchestra.run.smithi042.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2024-05-09T01:34:30.332 INFO:teuthology.orchestra.run.smithi042.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-05-09T01:34:30.432 INFO:teuthology.orchestra.run.smithi042.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-05-09T01:34:31.757 INFO:teuthology.orchestra.run.smithi042.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 789 kB/s | 1.0 MB 00:01 2024-05-09T01:34:31.883 INFO:teuthology.orchestra.run.smithi042.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 828 kB/s | 2.0 MB 00:02 2024-05-09T01:34:31.908 INFO:teuthology.orchestra.run.smithi042.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-05-09T01:34:32.075 INFO:teuthology.orchestra.run.smithi042.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 411 kB/s | 79 kB 00:00 2024-05-09T01:34:32.100 INFO:teuthology.orchestra.run.smithi042.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 301 kB/s | 58 kB 00:00 2024-05-09T01:34:32.200 INFO:teuthology.orchestra.run.smithi042.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-09T01:34:32.401 INFO:teuthology.orchestra.run.smithi042.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 450 kB/s | 90 kB 00:00 2024-05-09T01:34:32.509 INFO:teuthology.orchestra.run.smithi042.stdout:(135/156): libarrow-9.0.0-11.el9.x86_64.rpm 827 kB/s | 4.4 MB 00:05 2024-05-09T01:34:32.534 INFO:teuthology.orchestra.run.smithi042.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 593 kB/s | 272 kB 00:00 2024-05-09T01:34:32.559 INFO:teuthology.orchestra.run.smithi042.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 178 kB/s | 28 kB 00:00 2024-05-09T01:34:32.610 INFO:teuthology.orchestra.run.smithi042.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 305 kB/s | 31 kB 00:00 2024-05-09T01:34:32.718 INFO:teuthology.orchestra.run.smithi042.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2024-05-09T01:34:32.744 INFO:teuthology.orchestra.run.smithi042.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 321 kB/s | 59 kB 00:00 2024-05-09T01:34:32.802 INFO:teuthology.orchestra.run.smithi042.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 704 kB/s | 188 kB 00:00 2024-05-09T01:34:32.828 INFO:teuthology.orchestra.run.smithi042.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 468 kB/s | 51 kB 00:00 2024-05-09T01:34:32.987 INFO:teuthology.orchestra.run.smithi042.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 489 kB/s | 90 kB 00:00 2024-05-09T01:34:33.095 INFO:teuthology.orchestra.run.smithi042.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-05-09T01:34:33.120 INFO:teuthology.orchestra.run.smithi042.stdout:(145/156): python3-webob-1.8.7-6.el9.noarch.rpm 611 kB/s | 230 kB 00:00 2024-05-09T01:34:33.371 INFO:teuthology.orchestra.run.smithi042.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 696 kB/s | 192 kB 00:00 2024-05-09T01:34:33.438 INFO:teuthology.orchestra.run.smithi042.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 701 kB/s | 427 kB 00:00 2024-05-09T01:34:33.646 INFO:teuthology.orchestra.run.smithi042.stdout:(148/156): librados2-19.0.0-3594.gc9da4049.el9. 12 MB/s | 3.3 MB 00:00 2024-05-09T01:34:34.597 INFO:teuthology.orchestra.run.smithi042.stdout:(149/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-05-09T01:34:37.205 INFO:teuthology.orchestra.run.smithi042.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 665 kB/s | 2.3 MB 00:03 2024-05-09T01:34:37.314 INFO:teuthology.orchestra.run.smithi042.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 386 kB/s | 42 kB 00:00 2024-05-09T01:34:37.355 INFO:teuthology.orchestra.run.smithi042.stdout:(152/156): thrift-0.15.0-2.el9.x86_64.rpm 382 kB/s | 1.6 MB 00:04 2024-05-09T01:34:37.506 INFO:teuthology.orchestra.run.smithi042.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 1.3 MB/s | 248 kB 00:00 2024-05-09T01:34:38.190 INFO:teuthology.orchestra.run.smithi042.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 1.6 MB/s | 1.3 MB 00:00 2024-05-09T01:34:39.173 INFO:teuthology.orchestra.run.smithi042.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.4 MB/s | 2.4 MB 00:01 2024-05-09T01:34:40.174 INFO:teuthology.orchestra.run.smithi042.stdout:(156/156): NetworkManager-libnm-1.47.5-1.el9.x8 335 kB/s | 1.8 MB 00:05 2024-05-09T01:34:40.179 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-09T01:34:40.179 INFO:teuthology.orchestra.run.smithi042.stdout:Total 9.3 MB/s | 219 MB 00:23 2024-05-09T01:34:41.437 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-09T01:34:41.605 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-09T01:34:41.605 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-09T01:34:43.839 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-09T01:34:43.840 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-09T01:34:50.312 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-09T01:34:50.396 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T01:34:50.434 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T01:34:50.509 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T01:34:50.547 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T01:34:50.572 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T01:34:50.618 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T01:34:51.021 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T01:34:51.098 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T01:34:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T01:34:51.257 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T01:34:51.350 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T01:34:51.379 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T01:34:51.560 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T01:34:51.610 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T01:34:51.637 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T01:34:51.747 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T01:34:51.771 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T01:34:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T01:34:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T01:34:51.900 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T01:34:52.050 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T01:34:52.212 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T01:34:52.342 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T01:34:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T01:34:52.507 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T01:34:52.574 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T01:34:52.786 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T01:34:52.902 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T01:34:52.929 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T01:34:52.964 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T01:34:53.040 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T01:34:53.088 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T01:34:53.132 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T01:34:53.165 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T01:34:53.192 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T01:34:53.263 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T01:34:53.317 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T01:34:53.345 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T01:34:53.389 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T01:34:53.468 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T01:34:53.508 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T01:34:53.552 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T01:34:53.580 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T01:34:53.654 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T01:34:53.703 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T01:34:53.783 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T01:34:53.927 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T01:34:53.990 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T01:34:54.550 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T01:34:54.629 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T01:34:54.672 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T01:34:54.716 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T01:34:54.753 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T01:34:54.796 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T01:34:54.955 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T01:34:55.015 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T01:34:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T01:34:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T01:34:55.246 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T01:34:55.283 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T01:34:55.320 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T01:34:55.367 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T01:34:55.402 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T01:34:55.446 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T01:34:55.488 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T01:34:55.632 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T01:34:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T01:34:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T01:34:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T01:34:55.847 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T01:34:55.882 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T01:34:55.924 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T01:34:55.964 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T01:34:55.997 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T01:34:56.093 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T01:34:56.230 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T01:34:56.263 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T01:34:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T01:34:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T01:34:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T01:34:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T01:34:56.465 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T01:34:56.495 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T01:34:56.528 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T01:34:56.570 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T01:34:56.604 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T01:34:56.696 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T01:34:56.744 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T01:34:56.774 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T01:34:56.823 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T01:34:56.934 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T01:34:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T01:34:57.757 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T01:34:57.807 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T01:34:57.840 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T01:34:57.943 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T01:34:57.999 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T01:34:58.089 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T01:34:58.134 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T01:34:58.319 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T01:34:58.348 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T01:34:58.430 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T01:34:59.120 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T01:34:59.244 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T01:35:00.600 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T01:35:00.678 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T01:35:00.706 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T01:35:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T01:35:01.074 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T01:35:01.110 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T01:35:01.186 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T01:35:01.216 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T01:35:01.257 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T01:35:01.776 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T01:35:01.805 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T01:35:01.877 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T01:35:01.907 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T01:35:04.223 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T01:35:04.261 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T01:35:04.867 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T01:35:04.907 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T01:35:05.000 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T01:35:05.000 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T01:35:05.000 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T01:35:05.000 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:05.042 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T01:35:17.222 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-05-09T01:35:17.223 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T01:35:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T01:35:17.418 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:17.418 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T01:35:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:19.079 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T01:35:19.108 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T01:35:19.108 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:19.108 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T01:35:19.109 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T01:35:19.109 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T01:35:19.109 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:19.347 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T01:35:19.373 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T01:35:19.373 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:19.373 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T01:35:19.373 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T01:35:19.373 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T01:35:19.373 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:19.856 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T01:35:19.882 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T01:35:19.882 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:19.882 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T01:35:19.882 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T01:35:19.882 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T01:35:19.882 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:19.996 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T01:35:20.054 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T01:35:20.117 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T01:35:20.321 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T01:35:20.374 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T01:35:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T01:35:20.545 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T01:35:20.696 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T01:35:20.756 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T01:35:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T01:35:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T01:35:21.222 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T01:35:21.241 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T01:35:21.273 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T01:35:21.337 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T01:35:21.363 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T01:35:22.460 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T01:35:22.499 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T01:35:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T01:35:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T01:35:23.661 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T01:35:23.832 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T01:35:23.860 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T01:35:23.885 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T01:35:23.886 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:23.886 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T01:35:23.886 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T01:35:23.886 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T01:35:23.887 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:23.935 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T01:35:23.948 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T01:35:24.041 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T01:35:24.098 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T01:35:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T01:35:25.138 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T01:35:25.163 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T01:35:25.163 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:25.163 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T01:35:25.164 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T01:35:25.164 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T01:35:25.164 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:25.205 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T01:35:25.230 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T01:35:25.230 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:25.230 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T01:35:25.230 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:25.281 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T01:35:25.306 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T01:35:25.306 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:25.306 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T01:35:25.306 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T01:35:25.306 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T01:35:25.307 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T01:35:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T01:35:25.657 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:35:25.657 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T01:35:25.657 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T01:35:25.657 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T01:35:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:30.202 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T01:35:30.244 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T01:35:30.284 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T01:35:30.316 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T01:35:30.343 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T01:35:30.553 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T01:35:30.598 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T01:35:30.628 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T01:35:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T01:35:31.310 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T01:35:31.352 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T01:35:31.373 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T01:35:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T01:35:32.436 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T01:35:32.533 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T01:35:32.568 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T01:35:32.594 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T01:35:32.594 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T01:35:32.670 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T01:35:32.702 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T01:35:32.703 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T01:35:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T01:35:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T01:35:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T01:35:33.014 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T01:35:33.014 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T01:35:33.107 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T01:35:33.175 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T01:35:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T01:35:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T01:35:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T01:35:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T01:35:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T01:35:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T01:35:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T01:35:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T01:35:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T01:35:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T01:35:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T01:35:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T01:35:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T01:35:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T01:35:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T01:35:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-05-09T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.558 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T01:35:41.559 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T01:35:41.560 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T01:35:41.561 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T01:35:41.562 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T01:35:41.563 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T01:35:41.564 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T01:35:41.565 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T01:35:41.566 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:35:41.567 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T01:35:41.568 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:35:41.569 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-09T01:35:42.011 DEBUG:teuthology.parallel:result is None 2024-05-09T01:38:27.886 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 64 B/s | 16 kB 04:21 2024-05-09T01:38:30.239 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 21 MB 00:02 2024-05-09T01:38:35.362 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-05-09T01:38:37.680 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T01:38:37.681 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T01:38:37.691 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T01:38:37.692 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T01:38:37.693 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T01:38:37.694 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T01:38:37.696 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T01:38:37.698 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T01:38:37.699 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T01:38:37.762 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T01:38:37.788 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T01:38:37.789 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T01:38:37.790 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T01:38:37.791 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T01:38:37.792 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T01:38:37.793 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T01:38:37.794 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T01:38:37.795 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T01:38:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T01:38:37.797 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T01:38:37.798 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T01:38:37.799 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout:Install 148 Packages 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-05-09T01:38:37.800 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:38:37.801 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 219 M 2024-05-09T01:38:37.801 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-05-09T01:38:38.805 INFO:teuthology.orchestra.run.smithi181.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-09T01:38:39.973 INFO:teuthology.orchestra.run.smithi181.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 740 kB/s | 863 kB 00:01 2024-05-09T01:38:40.138 INFO:teuthology.orchestra.run.smithi181.stdout:(3/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 3.4 MB/s | 5.4 MB 00:01 2024-05-09T01:38:40.164 INFO:teuthology.orchestra.run.smithi181.stdout:(4/156): ceph-immutable-object-cache-19.0.0-359 765 kB/s | 147 kB 00:00 2024-05-09T01:38:40.647 INFO:teuthology.orchestra.run.smithi181.stdout:(5/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 4.4 MB/s | 2.3 MB 00:00 2024-05-09T01:38:41.348 INFO:teuthology.orchestra.run.smithi181.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-05-09T01:38:41.556 INFO:teuthology.orchestra.run.smithi181.stdout:(7/156): ceph-common-19.0.0-3594.gc9da4049.el9. 6.5 MB/s | 20 MB 00:03 2024-05-09T01:38:41.615 INFO:teuthology.orchestra.run.smithi181.stdout:(8/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 5.0 MB/s | 4.9 MB 00:00 2024-05-09T01:38:41.715 INFO:teuthology.orchestra.run.smithi181.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 251 kB/s | 25 kB 00:00 2024-05-09T01:38:44.223 INFO:teuthology.orchestra.run.smithi181.stdout:(10/156): ceph-radosgw-19.0.0-3594.gc9da4049.el 3.8 MB/s | 10 MB 00:02 2024-05-09T01:38:44.307 INFO:teuthology.orchestra.run.smithi181.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 2.6 MB/s | 224 kB 00:00 2024-05-09T01:38:44.399 INFO:teuthology.orchestra.run.smithi181.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 295 kB/s | 27 kB 00:00 2024-05-09T01:38:44.491 INFO:teuthology.orchestra.run.smithi181.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 347 kB/s | 32 kB 00:00 2024-05-09T01:38:44.741 INFO:teuthology.orchestra.run.smithi181.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 3.0 MB/s | 756 kB 00:00 2024-05-09T01:38:44.816 INFO:teuthology.orchestra.run.smithi181.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 2.1 MB/s | 158 kB 00:00 2024-05-09T01:38:44.891 INFO:teuthology.orchestra.run.smithi181.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.7 MB/s | 127 kB 00:00 2024-05-09T01:38:45.050 INFO:teuthology.orchestra.run.smithi181.stdout:(17/156): libradosstriper1-19.0.0-3594.gc9da404 3.1 MB/s | 497 kB 00:00 2024-05-09T01:38:46.584 INFO:teuthology.orchestra.run.smithi181.stdout:(18/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 3.4 MB/s | 5.2 MB 00:01 2024-05-09T01:38:46.642 INFO:teuthology.orchestra.run.smithi181.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 778 kB/s | 45 kB 00:00 2024-05-09T01:38:46.709 INFO:teuthology.orchestra.run.smithi181.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 2.0 MB/s | 135 kB 00:00 2024-05-09T01:38:46.801 INFO:teuthology.orchestra.run.smithi181.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.7 MB/s | 162 kB 00:00 2024-05-09T01:38:46.926 INFO:teuthology.orchestra.run.smithi181.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 2.5 MB/s | 321 kB 00:00 2024-05-09T01:38:47.062 INFO:teuthology.orchestra.run.smithi181.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.2 MB/s | 301 kB 00:00 2024-05-09T01:38:47.135 INFO:teuthology.orchestra.run.smithi181.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.3 MB/s | 99 kB 00:00 2024-05-09T01:38:47.211 INFO:teuthology.orchestra.run.smithi181.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-09T01:38:47.928 INFO:teuthology.orchestra.run.smithi181.stdout:(26/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 4.2 MB/s | 3.0 MB 00:00 2024-05-09T01:38:48.003 INFO:teuthology.orchestra.run.smithi181.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.2 MB/s | 169 kB 00:00 2024-05-09T01:38:48.095 INFO:teuthology.orchestra.run.smithi181.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 374 kB/s | 34 kB 00:00 2024-05-09T01:38:48.187 INFO:teuthology.orchestra.run.smithi181.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.5 MB/s | 142 kB 00:00 2024-05-09T01:38:49.562 INFO:teuthology.orchestra.run.smithi181.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 2.6 MB/s | 3.5 MB 00:01 2024-05-09T01:38:51.429 INFO:teuthology.orchestra.run.smithi181.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-05-09T01:38:51.554 INFO:teuthology.orchestra.run.smithi181.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.2 MB/s | 274 kB 00:00 2024-05-09T01:38:51.629 INFO:teuthology.orchestra.run.smithi181.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 657 kB/s | 49 kB 00:00 2024-05-09T01:38:51.688 INFO:teuthology.orchestra.run.smithi181.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 283 kB/s | 16 kB 00:00 2024-05-09T01:38:51.788 INFO:teuthology.orchestra.run.smithi181.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 2.7 MB/s | 273 kB 00:00 2024-05-09T01:38:51.980 INFO:teuthology.orchestra.run.smithi181.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 3.9 MB/s | 763 kB 00:00 2024-05-09T01:38:52.389 INFO:teuthology.orchestra.run.smithi181.stdout:(37/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 1.6 MB/s | 18 MB 00:11 2024-05-09T01:38:52.414 INFO:teuthology.orchestra.run.smithi181.stdout:(38/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 42 kB/s | 18 kB 00:00 2024-05-09T01:38:52.514 INFO:teuthology.orchestra.run.smithi181.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 643 kB/s | 80 kB 00:00 2024-05-09T01:38:52.589 INFO:teuthology.orchestra.run.smithi181.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-05-09T01:38:52.623 INFO:teuthology.orchestra.run.smithi181.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-05-09T01:38:52.648 INFO:teuthology.orchestra.run.smithi181.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-05-09T01:38:52.699 INFO:teuthology.orchestra.run.smithi181.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-05-09T01:38:52.724 INFO:teuthology.orchestra.run.smithi181.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-05-09T01:38:52.750 INFO:teuthology.orchestra.run.smithi181.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-09T01:38:52.775 INFO:teuthology.orchestra.run.smithi181.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-09T01:38:52.800 INFO:teuthology.orchestra.run.smithi181.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-09T01:38:53.092 INFO:teuthology.orchestra.run.smithi181.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-05-09T01:38:53.126 INFO:teuthology.orchestra.run.smithi181.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-05-09T01:38:53.159 INFO:teuthology.orchestra.run.smithi181.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-09T01:38:53.176 INFO:teuthology.orchestra.run.smithi181.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-05-09T01:38:53.227 INFO:teuthology.orchestra.run.smithi181.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-05-09T01:38:53.243 INFO:teuthology.orchestra.run.smithi181.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-05-09T01:38:53.294 INFO:teuthology.orchestra.run.smithi181.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-05-09T01:38:53.344 INFO:teuthology.orchestra.run.smithi181.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-05-09T01:38:53.403 INFO:teuthology.orchestra.run.smithi181.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-05-09T01:38:53.428 INFO:teuthology.orchestra.run.smithi181.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-05-09T01:38:53.462 INFO:teuthology.orchestra.run.smithi181.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-05-09T01:38:53.529 INFO:teuthology.orchestra.run.smithi181.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-05-09T01:38:53.587 INFO:teuthology.orchestra.run.smithi181.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-05-09T01:38:53.612 INFO:teuthology.orchestra.run.smithi181.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-05-09T01:38:53.646 INFO:teuthology.orchestra.run.smithi181.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-05-09T01:38:53.679 INFO:teuthology.orchestra.run.smithi181.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-05-09T01:38:53.713 INFO:teuthology.orchestra.run.smithi181.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-05-09T01:38:53.738 INFO:teuthology.orchestra.run.smithi181.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-05-09T01:38:53.914 INFO:teuthology.orchestra.run.smithi181.stdout:(66/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-05-09T01:38:54.014 INFO:teuthology.orchestra.run.smithi181.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-05-09T01:38:54.081 INFO:teuthology.orchestra.run.smithi181.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-05-09T01:38:54.115 INFO:teuthology.orchestra.run.smithi181.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-05-09T01:38:54.148 INFO:teuthology.orchestra.run.smithi181.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-05-09T01:38:54.298 INFO:teuthology.orchestra.run.smithi181.stdout:(71/156): postgresql-server-13.14-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-05-09T01:38:54.682 INFO:teuthology.orchestra.run.smithi181.stdout:(72/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 3.3 MB/s | 43 MB 00:12 2024-05-09T01:38:54.733 INFO:teuthology.orchestra.run.smithi181.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-05-09T01:38:54.758 INFO:teuthology.orchestra.run.smithi181.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 190 kB/s | 87 kB 00:00 2024-05-09T01:38:54.825 INFO:teuthology.orchestra.run.smithi181.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-05-09T01:38:54.883 INFO:teuthology.orchestra.run.smithi181.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-05-09T01:38:54.942 INFO:teuthology.orchestra.run.smithi181.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-05-09T01:38:54.984 INFO:teuthology.orchestra.run.smithi181.stdout:(78/156): python3-devel-3.9.18-3.el9.x86_64.rpm 973 kB/s | 244 kB 00:00 2024-05-09T01:38:55.009 INFO:teuthology.orchestra.run.smithi181.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-09T01:38:55.051 INFO:teuthology.orchestra.run.smithi181.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-05-09T01:38:55.135 INFO:teuthology.orchestra.run.smithi181.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-05-09T01:38:55.160 INFO:teuthology.orchestra.run.smithi181.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-09T01:38:55.202 INFO:teuthology.orchestra.run.smithi181.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-09T01:38:55.227 INFO:teuthology.orchestra.run.smithi181.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-09T01:38:55.303 INFO:teuthology.orchestra.run.smithi181.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-05-09T01:38:55.344 INFO:teuthology.orchestra.run.smithi181.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 298 kB/s | 42 kB 00:00 2024-05-09T01:38:55.370 INFO:teuthology.orchestra.run.smithi181.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-09T01:38:55.403 INFO:teuthology.orchestra.run.smithi181.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-05-09T01:38:55.429 INFO:teuthology.orchestra.run.smithi181.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-05-09T01:38:55.454 INFO:teuthology.orchestra.run.smithi181.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-05-09T01:38:55.479 INFO:teuthology.orchestra.run.smithi181.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-05-09T01:38:55.513 INFO:teuthology.orchestra.run.smithi181.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-05-09T01:38:55.538 INFO:teuthology.orchestra.run.smithi181.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-05-09T01:38:55.580 INFO:teuthology.orchestra.run.smithi181.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-05-09T01:38:55.605 INFO:teuthology.orchestra.run.smithi181.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-05-09T01:38:55.639 INFO:teuthology.orchestra.run.smithi181.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-09T01:38:55.673 INFO:teuthology.orchestra.run.smithi181.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-09T01:38:55.698 INFO:teuthology.orchestra.run.smithi181.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-05-09T01:38:55.732 INFO:teuthology.orchestra.run.smithi181.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-09T01:38:55.757 INFO:teuthology.orchestra.run.smithi181.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-09T01:38:55.790 INFO:teuthology.orchestra.run.smithi181.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-05-09T01:38:55.907 INFO:teuthology.orchestra.run.smithi181.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-05-09T01:38:56.083 INFO:teuthology.orchestra.run.smithi181.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-05-09T01:38:56.358 INFO:teuthology.orchestra.run.smithi181.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-05-09T01:38:56.525 INFO:teuthology.orchestra.run.smithi181.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 887 kB/s | 548 kB 00:00 2024-05-09T01:38:56.592 INFO:teuthology.orchestra.run.smithi181.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-05-09T01:38:56.675 INFO:teuthology.orchestra.run.smithi181.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 521 kB/s | 309 kB 00:00 2024-05-09T01:38:56.701 INFO:teuthology.orchestra.run.smithi181.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-05-09T01:38:56.768 INFO:teuthology.orchestra.run.smithi181.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-05-09T01:38:56.910 INFO:teuthology.orchestra.run.smithi181.stdout:(110/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-09T01:38:56.935 INFO:teuthology.orchestra.run.smithi181.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 288 kB/s | 67 kB 00:00 2024-05-09T01:38:56.960 INFO:teuthology.orchestra.run.smithi181.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 786 kB/s | 151 kB 00:00 2024-05-09T01:38:57.061 INFO:teuthology.orchestra.run.smithi181.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-05-09T01:38:57.094 INFO:teuthology.orchestra.run.smithi181.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-05-09T01:38:57.153 INFO:teuthology.orchestra.run.smithi181.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-05-09T01:38:57.186 INFO:teuthology.orchestra.run.smithi181.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-05-09T01:38:57.211 INFO:teuthology.orchestra.run.smithi181.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-05-09T01:38:57.262 INFO:teuthology.orchestra.run.smithi181.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-09T01:38:57.345 INFO:teuthology.orchestra.run.smithi181.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-05-09T01:38:57.371 INFO:teuthology.orchestra.run.smithi181.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-05-09T01:38:57.396 INFO:teuthology.orchestra.run.smithi181.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.6 MB/s | 303 kB 00:00 2024-05-09T01:38:57.446 INFO:teuthology.orchestra.run.smithi181.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-09T01:38:57.513 INFO:teuthology.orchestra.run.smithi181.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-09T01:38:57.572 INFO:teuthology.orchestra.run.smithi181.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-05-09T01:38:57.614 INFO:teuthology.orchestra.run.smithi181.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-05-09T01:38:57.673 INFO:teuthology.orchestra.run.smithi181.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-05-09T01:38:57.723 INFO:teuthology.orchestra.run.smithi181.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-05-09T01:38:57.740 INFO:teuthology.orchestra.run.smithi181.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 155 kB/s | 19 kB 00:00 2024-05-09T01:38:57.773 INFO:teuthology.orchestra.run.smithi181.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-05-09T01:38:57.840 INFO:teuthology.orchestra.run.smithi181.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-05-09T01:38:57.874 INFO:teuthology.orchestra.run.smithi181.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2024-05-09T01:38:57.915 INFO:teuthology.orchestra.run.smithi181.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-05-09T01:38:57.950 INFO:teuthology.orchestra.run.smithi181.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 529 kB/s | 58 kB 00:00 2024-05-09T01:38:58.025 INFO:teuthology.orchestra.run.smithi181.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-05-09T01:38:58.050 INFO:teuthology.orchestra.run.smithi181.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2024-05-09T01:38:58.076 INFO:teuthology.orchestra.run.smithi181.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-05-09T01:38:58.117 INFO:teuthology.orchestra.run.smithi181.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-05-09T01:38:58.159 INFO:teuthology.orchestra.run.smithi181.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-05-09T01:38:58.209 INFO:teuthology.orchestra.run.smithi181.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-09T01:38:58.235 INFO:teuthology.orchestra.run.smithi181.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-05-09T01:38:58.260 INFO:teuthology.orchestra.run.smithi181.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-05-09T01:38:58.302 INFO:teuthology.orchestra.run.smithi181.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 552 kB/s | 51 kB 00:00 2024-05-09T01:38:58.360 INFO:teuthology.orchestra.run.smithi181.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 897 kB/s | 90 kB 00:00 2024-05-09T01:38:58.386 INFO:teuthology.orchestra.run.smithi181.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-05-09T01:38:58.453 INFO:teuthology.orchestra.run.smithi181.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-05-09T01:38:58.470 INFO:teuthology.orchestra.run.smithi181.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-05-09T01:38:58.520 INFO:teuthology.orchestra.run.smithi181.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-05-09T01:38:58.704 INFO:teuthology.orchestra.run.smithi181.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-05-09T01:38:58.904 INFO:teuthology.orchestra.run.smithi181.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-05-09T01:38:58.971 INFO:teuthology.orchestra.run.smithi181.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 28 MB/s | 1.8 MB 00:00 2024-05-09T01:38:59.013 INFO:teuthology.orchestra.run.smithi181.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-05-09T01:38:59.063 INFO:teuthology.orchestra.run.smithi181.stdout:(152/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 5.7 MB/s | 3.1 MB 00:00 2024-05-09T01:38:59.088 INFO:teuthology.orchestra.run.smithi181.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 3.2 MB/s | 248 kB 00:00 2024-05-09T01:38:59.172 INFO:teuthology.orchestra.run.smithi181.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-05-09T01:38:59.231 INFO:teuthology.orchestra.run.smithi181.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 2024-05-09T01:38:59.356 INFO:teuthology.orchestra.run.smithi181.stdout:(156/156): librados2-19.0.0-3594.gc9da4049.el9. 3.8 MB/s | 3.3 MB 00:00 2024-05-09T01:38:59.359 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-05-09T01:38:59.359 INFO:teuthology.orchestra.run.smithi181.stdout:Total 10 MB/s | 219 MB 00:21 2024-05-09T01:39:00.512 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-05-09T01:39:00.662 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-05-09T01:39:00.662 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-05-09T01:39:02.802 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-05-09T01:39:02.802 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-05-09T01:39:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-05-09T01:39:09.052 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T01:39:09.094 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T01:39:09.260 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T01:39:09.310 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T01:39:09.336 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T01:39:09.395 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T01:39:09.731 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T01:39:09.853 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T01:39:09.999 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T01:39:10.030 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T01:39:10.138 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T01:39:10.167 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T01:39:10.343 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T01:39:10.398 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T01:39:10.426 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T01:39:10.514 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T01:39:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T01:39:10.589 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T01:39:10.611 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T01:39:10.629 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T01:39:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T01:39:11.027 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T01:39:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T01:39:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T01:39:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T01:39:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T01:39:11.640 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T01:39:11.770 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T01:39:11.802 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T01:39:11.842 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T01:39:11.915 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T01:39:11.950 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T01:39:11.994 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T01:39:12.026 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T01:39:12.054 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T01:39:12.123 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T01:39:12.177 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T01:39:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T01:39:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T01:39:12.328 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T01:39:12.362 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T01:39:12.405 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T01:39:12.433 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T01:39:12.502 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T01:39:12.556 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T01:39:12.630 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T01:39:12.764 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T01:39:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T01:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T01:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T01:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T01:39:13.492 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T01:39:13.522 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T01:39:13.571 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T01:39:13.717 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T01:39:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T01:39:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T01:39:13.961 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T01:39:14.037 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T01:39:14.069 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T01:39:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T01:39:14.151 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T01:39:14.188 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T01:39:14.231 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T01:39:14.274 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T01:39:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T01:39:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T01:39:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T01:39:14.525 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T01:39:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T01:39:14.659 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T01:39:14.702 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T01:39:14.733 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T01:39:14.758 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T01:39:14.843 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T01:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T01:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T01:39:15.038 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T01:39:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T01:39:15.108 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T01:39:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T01:39:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T01:39:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T01:39:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T01:39:15.279 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T01:39:15.314 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T01:39:15.400 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T01:39:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T01:39:15.484 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T01:39:15.530 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T01:39:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T01:39:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T01:39:16.390 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T01:39:16.440 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T01:39:16.474 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T01:39:16.571 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T01:39:16.632 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T01:39:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T01:39:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T01:39:16.944 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T01:39:16.982 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T01:39:17.067 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T01:39:17.704 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T01:39:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T01:39:19.089 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T01:39:19.178 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T01:39:19.206 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T01:39:19.239 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T01:39:19.558 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T01:39:19.602 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T01:39:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T01:39:19.723 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T01:39:19.846 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T01:39:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T01:39:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T01:39:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T01:39:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T01:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T01:39:22.861 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T01:39:23.442 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T01:39:23.481 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T01:39:23.557 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T01:39:23.557 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T01:39:23.557 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T01:39:23.557 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:23.599 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T01:39:35.392 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T01:39:35.392 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-05-09T01:39:35.392 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-05-09T01:39:35.392 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-05-09T01:39:35.392 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-05-09T01:39:35.392 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-05-09T01:39:35.393 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-05-09T01:39:35.393 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-05-09T01:39:35.393 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:35.581 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T01:39:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T01:39:35.597 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:35.597 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T01:39:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T01:39:37.245 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T01:39:37.245 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:37.245 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T01:39:37.245 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T01:39:37.245 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T01:39:37.245 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:37.477 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T01:39:37.500 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T01:39:37.500 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:37.500 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T01:39:37.500 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T01:39:37.501 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T01:39:37.501 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:37.969 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T01:39:37.992 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T01:39:37.992 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:37.992 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T01:39:37.992 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T01:39:37.992 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T01:39:37.993 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:38.091 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T01:39:38.148 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T01:39:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T01:39:38.397 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T01:39:38.437 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T01:39:38.523 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T01:39:38.612 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T01:39:38.752 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T01:39:38.802 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T01:39:38.837 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T01:39:38.864 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T01:39:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T01:39:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T01:39:39.337 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T01:39:39.398 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T01:39:39.428 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T01:39:40.464 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T01:39:40.496 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T01:39:41.458 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T01:39:41.488 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T01:39:41.598 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T01:39:41.757 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T01:39:41.790 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T01:39:41.814 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T01:39:41.814 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:41.814 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T01:39:41.814 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T01:39:41.814 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T01:39:41.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:41.874 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T01:39:41.886 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T01:39:41.985 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T01:39:42.044 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T01:39:42.978 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T01:39:43.010 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T01:39:43.034 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T01:39:43.034 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:43.034 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T01:39:43.034 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T01:39:43.034 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T01:39:43.035 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:43.086 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T01:39:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T01:39:43.108 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:43.109 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T01:39:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:43.153 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T01:39:43.176 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T01:39:43.176 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:43.176 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T01:39:43.176 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T01:39:43.177 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T01:39:43.177 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:43.487 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T01:39:43.510 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T01:39:43.511 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T01:39:43.511 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T01:39:43.511 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T01:39:43.511 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T01:39:43.511 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:47.766 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T01:39:47.808 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T01:39:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T01:39:47.897 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T01:39:47.933 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T01:39:48.132 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T01:39:48.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T01:39:48.209 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T01:39:48.239 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T01:39:48.294 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T01:39:48.942 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T01:39:48.974 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T01:39:48.994 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T01:39:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T01:39:49.913 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T01:39:49.959 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T01:39:50.053 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T01:39:50.083 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T01:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T01:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T01:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T01:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T01:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T01:39:50.319 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T01:39:50.344 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T01:39:50.358 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T01:39:50.358 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T01:39:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T01:39:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T01:39:50.630 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T01:39:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T01:39:56.537 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T01:39:56.537 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T01:39:56.537 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T01:39:56.537 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T01:39:56.537 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T01:39:56.537 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T01:39:56.538 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T01:39:56.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T01:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T01:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T01:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T01:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T01:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T01:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T01:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T01:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T01:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T01:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T01:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T01:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T01:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T01:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T01:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T01:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T01:39:58.960 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T01:39:58.960 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:58.960 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T01:39:58.961 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.962 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T01:39:58.963 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.964 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T01:39:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T01:39:58.966 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T01:39:58.967 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T01:39:58.968 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T01:39:58.969 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T01:39:58.970 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T01:39:58.971 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T01:39:58.972 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T01:39:58.973 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T01:39:58.973 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:39:58.973 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-05-09T01:39:59.385 DEBUG:teuthology.parallel:result is None 2024-05-09T01:39:59.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:39:59.614 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T01:39:59.642 INFO:teuthology.orchestra.run.smithi042.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T01:39:59.643 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T01:39:59.643 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T01:39:59.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:39:59.783 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T01:39:59.806 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T01:39:59.806 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T01:39:59.806 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T01:39:59.808 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T01:39:59.808 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:39:59.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T01:39:59.842 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:39:59.842 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T01:39:59.873 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T01:39:59.874 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:39:59.874 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T01:39:59.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T01:39:59.984 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:39:59.984 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T01:40:00.009 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T01:40:00.074 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T01:40:00.074 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:00.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T01:40:00.107 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T01:40:00.175 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:00.175 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T01:40:00.200 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T01:40:00.265 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T01:40:00.265 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:00.265 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T01:40:00.290 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T01:40:00.357 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:00.357 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T01:40:00.382 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T01:40:00.446 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T01:40:00.532 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T01:40:00.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-05-09T01:40:00.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-05-09T01:40:00.565 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T01:40:00.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T01:40:00.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T01:40:00.632 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T01:40:00.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T01:40:00.675 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T01:40:00.706 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T01:40:00.706 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T01:40:00.706 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T01:40:00.706 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:00.706 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T01:40:00.756 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T01:40:00.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T01:40:00.895 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:00.895 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T01:40:00.910 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T01:40:01.013 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T01:40:01.044 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T01:40:01.044 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T01:40:01.044 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957', 'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698957', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.183908-debug'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1722, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.183908-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlghCLNRezCFQisjCDEPfbkwWRP8BlQI8mZmzw6gPfnM8YiAUsqBPtDcGFHa5hTCZ9XNo/F8stmQDNtJ/hFH20=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXttXMZO3AeT39xUi7ErEDl8F5Bd0zlONzxMs685n4ePoI9ncVgWxtFghdLTAcj3gR2BwWfzlHCHez1URTkQoE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_22:06:20', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T01:40:01.045 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T01:40:01.047 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T01:40:01.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T01:40:01.102 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T01:40:01.158 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:01.158 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T01:40:01.181 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T01:40:01.181 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-05-09T01:40:01.236 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-09 01:35:33.586622417 +0000 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-09 01:33:33.951160612 +0000 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-09 01:33:33.951160612 +0000 2024-05-09T01:40:01.237 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-09 01:33:33.951160612 +0000 2024-05-09T01:40:01.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T01:40:01.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-09T01:40:01.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-09T01:40:01.301 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 9.4234e-05 s, 5.4 MB/s 2024-05-09T01:40:01.302 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T01:40:01.358 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-05-09T01:40:01.415 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-09 01:35:33.586622417 +0000 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-09 01:33:34.296156927 +0000 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-09 01:33:34.296156927 +0000 2024-05-09T01:40:01.416 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-09 01:33:34.296156927 +0000 2024-05-09T01:40:01.416 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T01:40:01.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-09T01:40:01.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-09T01:40:01.480 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000101271 s, 5.1 MB/s 2024-05-09T01:40:01.482 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T01:40:01.538 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-09 01:35:33.586622417 +0000 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-09 01:33:34.642153236 +0000 2024-05-09T01:40:01.595 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-09 01:33:34.642153236 +0000 2024-05-09T01:40:01.596 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-09 01:33:34.642153236 +0000 2024-05-09T01:40:01.596 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T01:40:01.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-09T01:40:01.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-09T01:40:01.660 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000101558 s, 5.0 MB/s 2024-05-09T01:40:01.661 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T01:40:01.718 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-09 01:35:33.587622406 +0000 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-09 01:33:34.984149587 +0000 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-09 01:33:34.984149587 +0000 2024-05-09T01:40:01.774 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-09 01:33:34.984149587 +0000 2024-05-09T01:40:01.775 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T01:40:01.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-09T01:40:01.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-09T01:40:01.838 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 8.5719e-05 s, 6.0 MB/s 2024-05-09T01:40:01.839 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T01:40:01.897 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:01.897 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:01.897 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T01:40:01.914 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T01:40:01.914 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-09 01:39:51.062771830 +0000 2024-05-09T01:40:01.971 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-09 01:33:27.155543820 +0000 2024-05-09T01:40:01.972 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-09 01:33:27.155543820 +0000 2024-05-09T01:40:01.972 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-05-09 01:33:27.155543820 +0000 2024-05-09T01:40:01.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T01:40:02.036 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-09T01:40:02.036 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-09T01:40:02.036 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000269996 s, 1.9 MB/s 2024-05-09T01:40:02.037 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T01:40:02.095 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-05-09T01:40:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T01:40:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:02.151 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-09T01:40:02.151 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:02.152 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:02.152 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-09 01:39:51.063771808 +0000 2024-05-09T01:40:02.152 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-09 01:33:27.504536304 +0000 2024-05-09T01:40:02.152 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-09 01:33:27.504536304 +0000 2024-05-09T01:40:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-05-09 01:33:27.504536304 +0000 2024-05-09T01:40:02.152 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T01:40:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-09T01:40:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-09T01:40:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.00023643 s, 2.2 MB/s 2024-05-09T01:40:02.217 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T01:40:02.274 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-09 01:39:51.063771808 +0000 2024-05-09T01:40:02.330 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-09 01:33:27.840529068 +0000 2024-05-09T01:40:02.331 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-09 01:33:27.840529068 +0000 2024-05-09T01:40:02.331 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-05-09 01:33:27.840529068 +0000 2024-05-09T01:40:02.331 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T01:40:02.393 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-09T01:40:02.394 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-09T01:40:02.394 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000188725 s, 2.7 MB/s 2024-05-09T01:40:02.395 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T01:40:02.451 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-05-09T01:40:02.506 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-09 01:39:51.064771786 +0000 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-09 01:33:28.351518063 +0000 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-09 01:33:28.351518063 +0000 2024-05-09T01:40:02.507 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-05-09 01:33:28.351518063 +0000 2024-05-09T01:40:02.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T01:40:02.570 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-09T01:40:02.570 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-09T01:40:02.570 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000185021 s, 2.8 MB/s 2024-05-09T01:40:02.571 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T01:40:02.627 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:02.627 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T01:40:02.627 INFO:tasks.ceph:Generating config... 2024-05-09T01:40:02.629 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-09T01:40:02.629 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-09T01:40:02.629 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T01:40:02.629 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T01:40:02.629 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-09T01:40:02.629 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-09T01:40:02.629 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-09T01:40:02.630 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-09T01:40:02.631 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-09T01:40:02.631 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T01:40:02.631 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T01:40:02.631 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T01:40:02.631 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T01:40:02.631 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T01:40:02.631 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-09T01:40:02.632 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T01:40:02.633 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-09T01:40:02.633 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T01:40:02.633 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-09T01:40:02.633 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T01:40:02.633 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T01:40:02.706 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T01:40:02.710 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T01:40:02.767 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T01:40:02.794 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.b', '172.21.15.181'), ('mon.c', '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]')] 2024-05-09T01:40:02.795 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-09T01:40:02.796 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:02.796 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T01:40:02.851 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --add b 172.21.15.181 --addv c '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:02.948 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:02.948 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid f3e448d1-28fc-4e6e-85c6-4e5031602bbf 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:fsid f3e448d1-28fc-4e6e-85c6-4e5031602bbf 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-05-09T01:40:02.952248+0000 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-05-09T01:40:02.952248+0000 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 17 (quincy) 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] mon.c 2024-05-09T01:40:02.949 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T01:40:02.950 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T01:40:02.966 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f3e448d1-28fc-4e6e-85c6-4e5031602bbf... 2024-05-09T01:40:02.967 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T01:40:03.009 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T01:40:03.052 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-05-09T01:40:03.052 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-05-09T01:40:03.052 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T01:40:03.052 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-05-09T01:40:03.052 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.052 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T01:40:03.053 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-05-09T01:40:03.054 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-05-09T01:40:03.055 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = f3e448d1-28fc-4e6e-85c6-4e5031602bbf 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-05-09T01:40:03.056 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.057 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-05-09T01:40:03.058 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: mon client directed command retry = 5 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject delay max = 1 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject delay probability = 0.005 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject delay type = client mds 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject socket failures = 2500 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: osd blocked scrub grace period = 3600 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: osd max markdown count = 1000 2024-05-09T01:40:03.059 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-05-09T01:40:03.060 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.061 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-05-09T01:40:03.062 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: client_shutdown_timeout = 120 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-05-09T01:40:03.063 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e] 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f] 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds balancer = 20 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal fragment size max = 10000 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal merge size = 5 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split bits = 3 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split size = 100 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2024-05-09T01:40:03.064 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: mds oft prefetch dirfrags = True 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: mds_dir_prefetch = True 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: mds_sleep_rank_change = 5000000.0 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: mon client directed command retry = 5 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject delay max = 1 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject delay probability = 0.005 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject delay type = client mds osd 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: ms inject socket failures = 2500 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-05-09T01:40:03.065 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.067 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-05-09T01:40:03.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-05-09T01:40:03.069 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.42,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = f3e448d1-28fc-4e6e-85c6-4e5031602bbf 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-05-09T01:40:03.070 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-05-09T01:40:03.071 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-05-09T01:40:03.072 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-05-09T01:40:03.073 INFO:teuthology.orchestra.run.smithi181.stdout: mon client directed command retry = 5 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay max = 1 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay probability = 0.005 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay type = client mds 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject socket failures = 2500 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: osd blocked scrub grace period = 3600 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-05-09T01:40:03.074 INFO:teuthology.orchestra.run.smithi181.stdout: osd max markdown count = 1000 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.075 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T01:40:03.076 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: mon down mkfs grace = 300 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-05-09T01:40:03.077 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: client_shutdown_timeout = 120 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-05-09T01:40:03.078 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.e] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.f] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal fragment size max = 10000 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal merge size = 5 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal split bits = 3 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal split size = 100 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-05-09T01:40:03.079 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: mds oft prefetch dirfrags = True 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: mds_dir_prefetch = True 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: mds_sleep_rank_change = 5000000.0 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: mon client directed command retry = 5 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay max = 1 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay probability = 0.005 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay type = client mds osd 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject socket failures = 2500 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-05-09T01:40:03.080 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-05-09T01:40:03.081 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T01:40:03.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T01:40:03.172 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T01:40:03.172 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:03.172 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T01:40:03.188 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:03.188 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T01:40:03.244 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:40:03.244 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:03.244 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T01:40:03.244 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T01:40:03.320 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:03.320 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:03.376 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:40:03.376 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:03.376 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T01:40:03.376 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T01:40:03.411 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:03.411 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:03.466 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T01:40:03.467 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T01:40:03.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T01:40:03.528 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T01:40:03.531 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T01:40:03.601 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T01:40:03.604 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T01:40:03.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T01:40:03.667 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T01:40:03.670 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T01:40:03.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T01:40:03.797 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T01:40:03.800 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-09T01:40:03.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-09T01:40:03.928 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-09T01:40:03.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-09T01:40:03.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T01:40:04.018 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T01:40:04.021 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T01:40:04.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T01:40:04.150 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T01:40:04.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-09T01:40:04.178 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-09T01:40:04.278 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-09T01:40:04.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-09T01:40:04.306 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T01:40:04.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T01:40:04.358 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T01:40:04.372 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T01:40:04.372 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T01:40:04.372 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T01:40:04.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:04.397 INFO:tasks.ceph:role: osd.0 2024-05-09T01:40:04.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:40:04.397 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T01:40:04.462 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:04.462 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:04.463 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:04.499 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-09T01:40:04.500 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-09T01:40:04.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T01:40:04.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T01:40:04.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T01:40:04.709 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:04.709 INFO:tasks.ceph:role: osd.1 2024-05-09T01:40:04.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:40:04.709 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T01:40:04.774 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:04.774 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:04.774 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:04.774 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:04.774 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:04.774 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:04.775 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:04.775 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:04.775 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:04.775 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:04.808 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-09T01:40:04.810 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-09T01:40:04.810 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T01:40:04.879 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T01:40:04.950 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T01:40:05.016 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:05.016 INFO:tasks.ceph:role: osd.2 2024-05-09T01:40:05.016 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:40:05.016 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T01:40:05.081 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:05.081 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:05.081 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:05.081 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:05.081 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:05.082 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:05.082 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:05.082 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:05.082 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:05.082 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:05.113 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-09T01:40:05.115 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-09T01:40:05.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T01:40:05.184 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T01:40:05.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T01:40:05.321 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:05.321 INFO:tasks.ceph:role: osd.3 2024-05-09T01:40:05.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:40:05.321 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:05.386 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:05.387 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:05.387 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:05.418 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-09T01:40:05.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-09T01:40:05.421 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T01:40:05.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T01:40:05.561 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:05.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:05.670+0000 7fad9c60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T01:40:05.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:05.670+0000 7fad9c60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T01:40:05.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:05.671+0000 7fad9c60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T01:40:05.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:05.671+0000 7fad9c60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T01:40:05.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:05.671+0000 7fad9c60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T01:40:05.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:05.671+0000 7fad9c60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T01:40:08.513 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T01:40:08.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:08.651+0000 7f631cba3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T01:40:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:08.651+0000 7f631cba3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T01:40:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:08.651+0000 7f631cba3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T01:40:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:08.651+0000 7f631cba3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T01:40:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:08.651+0000 7f631cba3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T01:40:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:08.652+0000 7f631cba3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T01:40:11.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T01:40:11.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:11.643+0000 7fed4063f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T01:40:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:11.643+0000 7fed4063f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T01:40:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:11.643+0000 7fed4063f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T01:40:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:11.643+0000 7fed4063f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T01:40:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:11.643+0000 7fed4063f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T01:40:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:11.644+0000 7fed4063f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T01:40:14.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T01:40:14.553 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:14.665+0000 7f29a1032640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T01:40:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:14.666+0000 7f29a1032640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T01:40:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:14.666+0000 7f29a1032640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T01:40:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:14.666+0000 7f29a1032640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T01:40:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:14.666+0000 7f29a1032640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T01:40:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:14.666+0000 7f29a1032640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T01:40:17.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T01:40:17.548 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T01:40:17.578 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:17.578 INFO:tasks.ceph:role: osd.4 2024-05-09T01:40:17.578 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:40:17.578 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T01:40:17.653 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:17.654 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:18.160 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-09T01:40:18.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-09T01:40:18.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T01:40:18.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T01:40:18.327 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T01:40:18.396 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:18.396 INFO:tasks.ceph:role: osd.5 2024-05-09T01:40:18.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:40:18.396 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T01:40:18.470 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:18.470 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:18.470 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:18.470 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:18.470 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:18.470 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:18.471 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:18.471 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:18.471 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:18.471 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:18.927 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-09T01:40:18.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-09T01:40:18.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T01:40:19.018 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T01:40:19.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T01:40:19.113 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:19.113 INFO:tasks.ceph:role: osd.6 2024-05-09T01:40:19.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:40:19.113 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T01:40:19.185 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:19.185 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:19.185 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:19.185 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:19.185 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:19.185 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:19.186 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:19.186 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:19.186 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:19.186 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:19.677 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-09T01:40:19.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-09T01:40:19.679 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T01:40:19.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T01:40:19.859 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T01:40:19.923 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T01:40:19.924 INFO:tasks.ceph:role: osd.7 2024-05-09T01:40:19.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:40:19.924 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T01:40:19.996 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T01:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-09T01:40:20.515 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-09T01:40:20.515 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T01:40:20.663 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T01:40:20.694 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:20.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:20.802+0000 7f3ea1431640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T01:40:20.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:20.803+0000 7f3ea1431640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T01:40:20.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:20.803+0000 7f3ea1431640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T01:40:20.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:20.803+0000 7f3ea1431640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T01:40:20.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:20.803+0000 7f3ea1431640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T01:40:20.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:20.803+0000 7f3ea1431640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T01:40:23.651 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T01:40:23.679 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:23.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:23.782+0000 7f688da1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T01:40:23.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:23.783+0000 7f688da1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T01:40:23.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:23.783+0000 7f688da1f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T01:40:23.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:23.783+0000 7f688da1f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T01:40:23.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:23.783+0000 7f688da1f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T01:40:23.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:23.783+0000 7f688da1f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T01:40:26.636 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T01:40:26.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:26.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:26.770+0000 7f8722817640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T01:40:26.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:26.770+0000 7f8722817640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T01:40:26.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:26.770+0000 7f8722817640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T01:40:26.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:26.770+0000 7f8722817640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T01:40:26.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:26.770+0000 7f8722817640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T01:40:26.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:26.771+0000 7f8722817640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T01:40:29.631 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T01:40:29.662 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:29.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:29.760+0000 7fdf5ce1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T01:40:29.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:29.760+0000 7fdf5ce1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T01:40:29.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:29.760+0000 7fdf5ce1a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T01:40:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:29.760+0000 7fdf5ce1a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T01:40:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:29.760+0000 7fdf5ce1a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T01:40:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:29.761+0000 7fdf5ce1a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T01:40:31.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:40:31.049 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:40:32.621 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T01:40:32.650 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T01:40:32.651 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:32.651 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T01:40:32.682 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:32.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T01:40:32.752 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:32.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-09T01:40:32.822 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:32.822 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-09T01:40:32.891 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:32.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T01:40:32.959 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:32.960 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T01:40:33.028 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:33.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T01:40:33.096 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:33.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T01:40:33.164 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.164 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T01:40:33.194 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T01:40:33.263 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.263 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-09T01:40:33.332 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.332 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-09T01:40:33.399 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.399 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T01:40:33.466 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.466 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T01:40:33.532 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.532 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T01:40:33.598 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:33.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T01:40:33.664 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:33.664 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T01:40:33.682 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T01:40:33.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T01:40:33.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBzKTxmNb+9HxAAatFaddrUUVgD8vZg5+9tFA== 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBzKTxmlOz9JxAANyjnEseEwq8EohnFv8qbEQ== 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBzKTxmXAC/LxAAH2VLKeRY6lNYKOJRPikuFA== 2024-05-09T01:40:33.748 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.e] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBzKTxmTRmKNxAAkq9eBlL8mHUcsfYBYNdyIA== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB1KTxm2rgKKBAA8Rz1BxFMUXeqQj0AKs4UeQ== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB4KTxm9z3lJhAApOcy8BzPAUmHewo/pem0kw== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB7KTxmDPtrJhAA3nV2f8O5XT1f01ZjL0CDeQ== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB+KTxmWMS+JxAANEouL039lh9jk7DQiGXTjw== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBzKTxmCwkVJBAA/w6xw6CjIaDHfPtZvZliTg== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB0KTxmbHZRARAAJj1hYvMBvDOfrwQ89RoOGA== 2024-05-09T01:40:33.749 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB0KTxmSaguCRAA10aOeGuKToXzPcqJM/sYdA== 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.f] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB0KTxmhRTREBAAjXCM0N7aTjoINeUp9JWIKw== 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCEKTxm2WDqLxAAk2RogDmEjtVnoBmaAakJdA== 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCHKTxmNBy4LhAAWKWy5sWGJ2iL227Slefukg== 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCKKTxmEmD7LRAAuEbC3wumGFmSh0cIuVyJVA== 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCNKTxmoQNmLRAAror/kQPiB8TqjmNcw68znw== 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-05-09T01:40:33.750 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB0KTxm7BKVFRAAVY6Ls70XABPD8KNYrTpWDA== 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBzKTxmNb+9HxAAatFaddrUUVgD8vZg5+9tFA== 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBzKTxmlOz9JxAANyjnEseEwq8EohnFv8qbEQ== 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBzKTxmXAC/LxAAH2VLKeRY6lNYKOJRPikuFA== 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e] 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBzKTxmTRmKNxAAkq9eBlL8mHUcsfYBYNdyIA== 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-05-09T01:40:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB1KTxm2rgKKBAA8Rz1BxFMUXeqQj0AKs4UeQ== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB4KTxm9z3lJhAApOcy8BzPAUmHewo/pem0kw== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB7KTxmDPtrJhAA3nV2f8O5XT1f01ZjL0CDeQ== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB+KTxmWMS+JxAANEouL039lh9jk7DQiGXTjw== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBzKTxmCwkVJBAA/w6xw6CjIaDHfPtZvZliTg== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB0KTxmbHZRARAAJj1hYvMBvDOfrwQ89RoOGA== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB0KTxmSaguCRAA10aOeGuKToXzPcqJM/sYdA== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f] 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB0KTxmhRTREBAAjXCM0N7aTjoINeUp9JWIKw== 2024-05-09T01:40:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCEKTxm2WDqLxAAk2RogDmEjtVnoBmaAakJdA== 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCHKTxmNBy4LhAAWKWy5sWGJ2iL227Slefukg== 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCKKTxmEmD7LRAAuEbC3wumGFmSh0cIuVyJVA== 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCNKTxmoQNmLRAAror/kQPiB8TqjmNcw68znw== 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-05-09T01:40:33.754 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB0KTxm7BKVFRAAVY6Ls70XABPD8KNYrTpWDA== 2024-05-09T01:40:33.754 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T01:40:33.794 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T01:40:33.860 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:33.862 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:33.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:33.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:33.997 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:33.999 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.190 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.257 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.318 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T01:40:34.320 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T01:40:34.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.383 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.450 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.517 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T01:40:34.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.583 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.645 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.707 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.709 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.772 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.774 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T01:40:34.836 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T01:40:34.839 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T01:40:34.905 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T01:40:34.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T01:40:34.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T01:40:35.041 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T01:40:35.067 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T01:40:35.092 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T01:40:35.201 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T01:40:35.226 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T01:40:35.291 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T01:40:35.399 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T01:40:35.424 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:35.426 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T01:40:35.480 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T01:40:35.480 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T01:40:35.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T01:40:35.483 INFO:tasks.ceph.mon.a:Started 2024-05-09T01:40:35.483 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T01:40:35.483 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T01:40:35.523 INFO:tasks.ceph.mon.b:Started 2024-05-09T01:40:35.523 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T01:40:35.523 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T01:40:35.525 INFO:tasks.ceph.mon.c:Started 2024-05-09T01:40:35.526 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T01:40:35.526 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T01:40:35.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T01:40:35.529 INFO:tasks.ceph.mgr.y:Started 2024-05-09T01:40:35.529 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T01:40:35.529 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T01:40:35.531 INFO:tasks.ceph.mgr.x:Started 2024-05-09T01:40:35.531 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T01:40:35.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T01:40:35.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.651+0000 7fb395376640 1 Processor -- start 2024-05-09T01:40:35.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.651+0000 7fb395376640 1 -- start start 2024-05-09T01:40:35.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb395376640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 0x7fb39015b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb395376640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb3900ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb395376640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3900c87f0 con 0x7fb3900c5250 2024-05-09T01:40:35.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb395376640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb3900ca0c0 con 0x7fb390154f60 2024-05-09T01:40:35.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb395376640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb39015bb80 con 0x7fb3900cdd20 2024-05-09T01:40:35.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb38effd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb3900c5250 0x7fb3900c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:42570/0 (socket says 172.21.15.42:42570) 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb38effd640 1 -- 172.21.15.42:0/2855010822 learned_addr learned my addr 172.21.15.42:0/2855010822 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb3867fc640 1 --2- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 0x7fb39015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb3867fc640 1 -- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 msgr2=0x7fb39015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb3867fc640 1 -- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 msgr2=0x7fb39015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb3867fc640 1 --2- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 0x7fb39015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.652+0000 7fb3867fc640 1 --2- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 0x7fb39015b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.653+0000 7fb38f7fe640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb3900ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.653+0000 7fb38f7fe640 1 -- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 msgr2=0x7fb3900ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.653+0000 7fb38f7fe640 1 -- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 msgr2=0x7fb3900ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.653+0000 7fb38f7fe640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb3900ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T01:40:35.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.653+0000 7fb38f7fe640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb3900ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T01:40:35.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935621099 0 0) 0x7fb3900c87f0 con 0x7fb3900c5250 2024-05-09T01:40:35.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb37c003520 con 0x7fb3900c5250 2024-05-09T01:40:35.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2780485381 0 0) 0x7fb37c003520 con 0x7fb3900c5250 2024-05-09T01:40:35.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 msgr2=0x7fb3900ce130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:40:35.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb3900ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 msgr2=0x7fb39015b640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 --2- 172.21.15.42:0/2855010822 >> v2:172.21.15.42:3300/0 conn(0x7fb390154f60 0x7fb39015b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3900c9c80 con 0x7fb3900c5250 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7fb3800016f0 con 0x7fb3900c5250 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 >> v1:172.21.15.42:6789/0 conn(0x7fb3900c5250 legacy=0x7fb3900c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb37c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb37c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37c004d40 0x7fb37c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c00bc00 con 0x7fb37c003a50 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c00bd80 con 0x7fb37c004d40 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c00bf80 con 0x7fb3900cdd20 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38effd640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb37c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38f7fe640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37c004d40 0x7fb37c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb3867fc640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb37c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38effd640 1 -- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 msgr2=0x7fb37c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38effd640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb37c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38effd640 1 -- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37c004d40 msgr2=0x7fb37c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38effd640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37c004d40 0x7fb37c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb38effd640 1 -- 172.21.15.42:0/2855010822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c003520 con 0x7fb37c003a50 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.807+0000 7fb3867fc640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3900cdd20 0x7fb37c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.808+0000 7fb38effd640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb37c003ec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c160 tx=0x7fb37c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8e0a48ee53082e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.808+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380007ca0 con 0x7fb37c003a50 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.808+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb380005af0 con 0x7fb37c003a50 2024-05-09T01:40:35.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.808+0000 7fb38e7fc640 1 -- 172.21.15.42:0/2855010822 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380007070 con 0x7fb37c003a50 2024-05-09T01:40:35.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb395376640 1 -- 172.21.15.42:0/2855010822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 msgr2=0x7fb37c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:35.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb395376640 1 --2- 172.21.15.42:0/2855010822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb37c003ec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c160 tx=0x7fb37c005830 comp rx=0 tx=0).stop 2024-05-09T01:40:35.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb38f7fe640 1 -- 172.21.15.42:0/2855010822 reap_dead start 2024-05-09T01:40:35.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb395376640 1 -- 172.21.15.42:0/2855010822 shutdown_connections 2024-05-09T01:40:35.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb395376640 1 -- 172.21.15.42:0/2855010822 >> 172.21.15.42:0/2855010822 conn(0x7fb39006cca0 msgr2=0x7fb3900703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:35.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb395376640 1 -- 172.21.15.42:0/2855010822 shutdown_connections 2024-05-09T01:40:35.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.809+0000 7fb395376640 1 -- 172.21.15.42:0/2855010822 wait complete. 2024-05-09T01:40:35.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.811+0000 7fb395376640 1 Processor -- start 2024-05-09T01:40:35.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.811+0000 7fb395376640 1 -- start start 2024-05-09T01:40:35.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb395376640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb39014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb395376640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3901581f0 0x7fb390146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb395376640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb390144930 0x7fb390149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:35.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb395376640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb3900c8a90 con 0x7fb37c003a50 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb395376640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb390155370 con 0x7fb390144930 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb395376640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb3900c8d70 con 0x7fb3901581f0 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb39014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb39014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58650/0 (socket says 172.21.15.42:58650) 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 -- 172.21.15.42:0/3781290707 learned_addr learned my addr 172.21.15.42:0/3781290707 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb3867fc640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3901581f0 0x7fb390146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38f7fe640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb390144930 0x7fb390149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 -- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3901581f0 msgr2=0x7fb390146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3901581f0 0x7fb390146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 -- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb390144930 msgr2=0x7fb390149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb390144930 0x7fb390149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 -- 172.21.15.42:0/3781290707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39014bad0 con 0x7fb37c003a50 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb38effd640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb39014b590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c280 tx=0x7fb3900c4d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:35.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.813+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800016b0 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb380042070 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb390145480 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380007290 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb390145720 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb380032430 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb38003d5b0 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.814+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39014b1b0 con 0x7fb37c003a50 2024-05-09T01:40:35.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.817+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb3800328b0 con 0x7fb37c003a50 2024-05-09T01:40:35.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.885+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb3900c9ea0 con 0x7fb37c003a50 2024-05-09T01:40:35.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.887+0000 7fb387fff640 1 -- 172.21.15.42:0/3781290707 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fb380032a90 con 0x7fb37c003a50 2024-05-09T01:40:35.884 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-05-09T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.887+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 msgr2=0x7fb39014b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.887+0000 7fb395376640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb39014b590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c280 tx=0x7fb3900c4d60 comp rx=0 tx=0).stop 2024-05-09T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 shutdown_connections 2024-05-09T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb390144930 0x7fb390149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3901581f0 0x7fb390146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 --2- 172.21.15.42:0/3781290707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb37c003a50 0x7fb39014b590 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:35.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 >> 172.21.15.42:0/3781290707 conn(0x7fb39006cca0 msgr2=0x7fb390153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:35.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 shutdown_connections 2024-05-09T01:40:35.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:35.888+0000 7fb395376640 1 -- 172.21.15.42:0/3781290707 wait complete. 2024-05-09T01:40:35.896 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T01:40:35.896 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T01:40:35.897 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:35.897 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T01:40:35.913 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:35.916+0000 7f57077dc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T01:40:35.923 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:35.923 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T01:40:35.931 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:35.934+0000 7f6d7d770040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T01:40:35.956 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:35.957 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T01:40:36.023 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:40:36.024 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T01:40:36.080 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:36.083+0000 7f57077dc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T01:40:36.090 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:36.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T01:40:36.098 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:36.101+0000 7f6d7d770040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T01:40:36.115 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:36.116 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T01:40:36.137 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:36.139+0000 7f57077dc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T01:40:36.155 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:36.158+0000 7f6d7d770040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T01:40:36.161 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:36.161 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T01:40:36.226 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-09T01:40:36.226 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T01:40:36.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new cbf418ce-e7b6-4183-a201-c760dadfa132 0 2024-05-09T01:40:36.397 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:36.400+0000 7f57077dc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T01:40:36.409 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:36.412+0000 7f6d7d770040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T01:40:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.448+0000 7f1e460bd640 1 Processor -- start 2024-05-09T01:40:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.448+0000 7f1e460bd640 1 -- start start 2024-05-09T01:40:36.446 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:36.449+0000 7f57077dc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e460bd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 0x7f1e40153a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e460bd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1e400cbd00 0x7f1e400cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e460bd640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e400cad50 con 0x7f1e400c8170 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e460bd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1e400c6570 con 0x7f1e400cbd00 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e460bd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1e400c6850 con 0x7f1e400745d0 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 0x7f1e40153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1e400cbd00 0x7f1e400cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1e400cbd00 0x7f1e400cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57724/0 (socket says 172.21.15.181:57724) 2024-05-09T01:40:36.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 0x7f1e40153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53082/0 (socket says 172.21.15.181:53082) 2024-05-09T01:40:36.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 -- 172.21.15.181:0/4222761739 learned_addr learned my addr 172.21.15.181:0/4222761739 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:36.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 -- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 msgr2=0x7f1e40153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:36.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 --2- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 0x7f1e40153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 -- 172.21.15.181:0/4222761739 >> v1:172.21.15.42:6789/0 conn(0x7f1e400c8170 legacy=0x7f1e400c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e3ffff640 1 -- 172.21.15.181:0/4222761739 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e400cb030 con 0x7f1e400cbd00 2024-05-09T01:40:36.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.450+0000 7f1e37fff640 1 --2- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 0x7f1e40153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:36.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.451+0000 7f1e3ffff640 1 --2- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400cbd00 0x7f1e400cc110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0a252b81f43da27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:36.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.451+0000 7f1e3effd640 1 -- 172.21.15.181:0/4222761739 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38036070 con 0x7f1e400cbd00 2024-05-09T01:40:36.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.451+0000 7f1e3effd640 1 -- 172.21.15.181:0/4222761739 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e38031600 con 0x7f1e400cbd00 2024-05-09T01:40:36.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.451+0000 7f1e3effd640 1 -- 172.21.15.181:0/4222761739 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380319d0 con 0x7f1e400cbd00 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 -- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400cbd00 msgr2=0x7f1e400cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 --2- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400cbd00 0x7f1e400cc110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3802a680 comp rx=0 tx=0).stop 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 -- 172.21.15.181:0/4222761739 shutdown_connections 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 --2- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400cbd00 0x7f1e400cc110 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 --2- 172.21.15.181:0/4222761739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400745d0 0x7f1e40153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 -- 172.21.15.181:0/4222761739 >> 172.21.15.181:0/4222761739 conn(0x7f1e40071750 msgr2=0x7f1e40071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 -- 172.21.15.181:0/4222761739 shutdown_connections 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.452+0000 7f1e460bd640 1 -- 172.21.15.181:0/4222761739 wait complete. 2024-05-09T01:40:36.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.454+0000 7f1e460bd640 1 Processor -- start 2024-05-09T01:40:36.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.454+0000 7f1e460bd640 1 -- start start 2024-05-09T01:40:36.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e460bd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 0x7f1e401f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e460bd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e400c8170 0x7f1e401e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e460bd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400cbd00 0x7f1e401e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e460bd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400c92f0 con 0x7f1e400c8170 2024-05-09T01:40:36.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e460bd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400cb5f0 con 0x7f1e400745d0 2024-05-09T01:40:36.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e460bd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1e400c98b0 con 0x7f1e400cbd00 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e3f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 0x7f1e401f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e3ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400cbd00 0x7f1e401e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e3f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 0x7f1e401f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57734/0 (socket says 172.21.15.181:57734) 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e3f7fe640 1 -- 172.21.15.181:0/2850854381 learned_addr learned my addr 172.21.15.181:0/2850854381 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.455+0000 7f1e37fff640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e400c8170 0x7f1e401e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3f7fe640 1 -- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400cbd00 msgr2=0x7f1e401e47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3f7fe640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400cbd00 0x7f1e401e47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3f7fe640 1 -- 172.21.15.181:0/2850854381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e400c8170 msgr2=0x7f1e401e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3f7fe640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e400c8170 0x7f1e401e3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3f7fe640 1 -- 172.21.15.181:0/2850854381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e400cccb0 con 0x7f1e400745d0 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3f7fe640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 0x7f1e401f0b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000c3a0 tx=0x7f1e3000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:36.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30017070 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e300052d0 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e401f1050 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30003830 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e401e5930 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1e3001a070 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.456+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1e3001c440 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.457+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e400cce80 con 0x7f1e400745d0 2024-05-09T01:40:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.459+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1e30021020 con 0x7f1e400745d0 2024-05-09T01:40:36.457 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:36.460+0000 7f6d7d770040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T01:40:36.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.530+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cbf418ce-e7b6-4183-a201-c760dadfa132", "id": 0} v 0) -- 0x7f1e40159620 con 0x7f1e400745d0 2024-05-09T01:40:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e3cff9640 1 -- 172.21.15.181:0/2850854381 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cbf418ce-e7b6-4183-a201-c760dadfa132", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1e30011590 con 0x7f1e400745d0 2024-05-09T01:40:36.535 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 msgr2=0x7f1e401f0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 0x7f1e401f0b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000c3a0 tx=0x7f1e3000c860 comp rx=0 tx=0).stop 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 shutdown_connections 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e400cbd00 0x7f1e401e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e400c8170 0x7f1e401e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 --2- 172.21.15.181:0/2850854381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e400745d0 0x7f1e401f0b10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.534+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 >> 172.21.15.181:0/2850854381 conn(0x7f1e40071750 msgr2=0x7f1e40159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.535+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 shutdown_connections 2024-05-09T01:40:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.535+0000 7f1e460bd640 1 -- 172.21.15.181:0/2850854381 wait complete. 2024-05-09T01:40:36.543 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 95921d26-b7b4-4f38-ad56-af1d5921189e 1 2024-05-09T01:40:36.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.655+0000 7f98b6049640 1 Processor -- start 2024-05-09T01:40:36.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.656+0000 7f98b6049640 1 -- start start 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98b6049640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b006fe90 0x7f98b01652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98b6049640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b00c9c90 con 0x7f98b015db60 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98b6049640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b00cb6f0 con 0x7f98b00cabf0 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98b6049640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f98b015d6d0 con 0x7f98b006fe90 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98af7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f98b00cabf0 0x7f98b0159980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49962/0 (socket says 172.21.15.181:49962) 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98af7fe640 1 -- 172.21.15.181:0/2013384699 learned_addr learned my addr 172.21.15.181:0/2013384699 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98affff640 1 --2- 172.21.15.181:0/2013384699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b006fe90 0x7f98b01652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98ae7fc640 1 -- 172.21.15.181:0/2013384699 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286454262 0 0) 0x7f98b00cb6f0 con 0x7f98b00cabf0 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98ae7fc640 1 -- 172.21.15.181:0/2013384699 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f989c003520 con 0x7f98b00cabf0 2024-05-09T01:40:36.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98affff640 1 -- 172.21.15.181:0/2013384699 >> v1:172.21.15.181:6789/0 conn(0x7f98b00cabf0 legacy=0x7f98b0159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98ae7fc640 1 -- 172.21.15.181:0/2013384699 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 763911458 0 0) 0x7f98b00c9c90 con 0x7f98b015db60 2024-05-09T01:40:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98affff640 1 -- 172.21.15.181:0/2013384699 >> v1:172.21.15.42:6789/0 conn(0x7f98b015db60 legacy=0x7f98b00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.657+0000 7f98affff640 1 -- 172.21.15.181:0/2013384699 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b00cb130 con 0x7f98b006fe90 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.658+0000 7f98affff640 1 --2- 172.21.15.181:0/2013384699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b006fe90 0x7f98b01652f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98a800f3a0 tx=0x7f98a802ea60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed2b67eb44bd1057 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.658+0000 7f98ae7fc640 1 -- 172.21.15.181:0/2013384699 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8036070 con 0x7f98b006fe90 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.658+0000 7f98ae7fc640 1 -- 172.21.15.181:0/2013384699 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a800d4e0 con 0x7f98b006fe90 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.658+0000 7f98ae7fc640 1 -- 172.21.15.181:0/2013384699 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a800b960 con 0x7f98b006fe90 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 -- 172.21.15.181:0/2013384699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b006fe90 msgr2=0x7f98b01652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 --2- 172.21.15.181:0/2013384699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b006fe90 0x7f98b01652f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98a800f3a0 tx=0x7f98a802ea60 comp rx=0 tx=0).stop 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 -- 172.21.15.181:0/2013384699 shutdown_connections 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 --2- 172.21.15.181:0/2013384699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b006fe90 0x7f98b01652f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 -- 172.21.15.181:0/2013384699 >> 172.21.15.181:0/2013384699 conn(0x7f98b006d780 msgr2=0x7f98b006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 -- 172.21.15.181:0/2013384699 shutdown_connections 2024-05-09T01:40:36.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.659+0000 7f98b6049640 1 -- 172.21.15.181:0/2013384699 wait complete. 2024-05-09T01:40:36.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.661+0000 7f98b6049640 1 Processor -- start 2024-05-09T01:40:36.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.661+0000 7f98b6049640 1 -- start start 2024-05-09T01:40:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.662+0000 7f98b6049640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 0x7f98b0157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.662+0000 7f98b6049640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b00cabf0 0x7f98b014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.662+0000 7f98b6049640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b015db60 0x7f98b01e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.662+0000 7f98b6049640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f98b015d360 con 0x7f98b00cabf0 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.662+0000 7f98b6049640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f98b015d080 con 0x7f98b006fe90 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.662+0000 7f98b6049640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f98b006f1d0 con 0x7f98b015db60 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 0x7f98b0157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98affff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b015db60 0x7f98b01e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 0x7f98b0157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57738/0 (socket says 172.21.15.181:57738) 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 -- 172.21.15.181:0/1410495315 learned_addr learned my addr 172.21.15.181:0/1410495315 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98aeffd640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b00cabf0 0x7f98b014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 -- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b015db60 msgr2=0x7f98b01e42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b015db60 0x7f98b01e42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 -- 172.21.15.181:0/1410495315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b00cabf0 msgr2=0x7f98b014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b00cabf0 0x7f98b014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 -- 172.21.15.181:0/1410495315 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b014e060 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98af7fe640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 0x7f98b0157ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c430 tx=0x7f98a000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00075a0 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a00047e0 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b015ae90 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0004bd0 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b015a020 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f98a001d3f0 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.663+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f98a0012820 con 0x7f98b006fe90 2024-05-09T01:40:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.664+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b014d740 con 0x7f98b006fe90 2024-05-09T01:40:36.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.667+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f98a0012a70 con 0x7f98b006fe90 2024-05-09T01:40:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.736+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "95921d26-b7b4-4f38-ad56-af1d5921189e", "id": 1} v 0) -- 0x7f98b00764e0 con 0x7f98b006fe90 2024-05-09T01:40:36.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.740+0000 7f98a7fff640 1 -- 172.21.15.181:0/1410495315 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95921d26-b7b4-4f38-ad56-af1d5921189e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f98a0012d20 con 0x7f98b006fe90 2024-05-09T01:40:36.738 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 msgr2=0x7f98b0157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 0x7f98b0157ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c430 tx=0x7f98a000c8f0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 shutdown_connections 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b015db60 0x7f98b01e42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b00cabf0 0x7f98b014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 --2- 172.21.15.181:0/1410495315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b006fe90 0x7f98b0157ff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 >> 172.21.15.181:0/1410495315 conn(0x7f98b006d780 msgr2=0x7f98b006c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 shutdown_connections 2024-05-09T01:40:36.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.741+0000 7f98b6049640 1 -- 172.21.15.181:0/1410495315 wait complete. 2024-05-09T01:40:36.750 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 0bca03e9-6a2a-4b3b-9d2d-9d68328573e2 2 2024-05-09T01:40:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.864+0000 7fa9e6794640 1 Processor -- start 2024-05-09T01:40:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.864+0000 7fa9e6794640 1 -- start start 2024-05-09T01:40:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.865+0000 7fa9e6794640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9e006f1d0 0x7fa9e00ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.865+0000 7fa9e6794640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e006d230 0x7fa9e01675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.865+0000 7fa9e6794640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e00c9990 con 0x7fa9e00ca560 2024-05-09T01:40:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.865+0000 7fa9e6794640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa9e015d6e0 con 0x7fa9e006f1d0 2024-05-09T01:40:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.865+0000 7fa9e6794640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e015dbf0 con 0x7fa9e006d230 2024-05-09T01:40:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9e4d31640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e006d230 0x7fa9e01675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9df7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa9e00ca560 0x7fa9e00cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49974/0 (socket says 172.21.15.181:49974) 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9df7fe640 1 -- 172.21.15.181:0/952562166 learned_addr learned my addr 172.21.15.181:0/952562166 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9dffff640 1 --2- 172.21.15.181:0/952562166 >> v2:172.21.15.42:3300/0 conn(0x7fa9e006f1d0 0x7fa9e00ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9deffd640 1 -- 172.21.15.181:0/952562166 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579253169 0 0) 0x7fa9e00c9990 con 0x7fa9e00ca560 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9e4d31640 1 -- 172.21.15.181:0/952562166 >> v2:172.21.15.42:3300/0 conn(0x7fa9e006f1d0 msgr2=0x7fa9e00ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9e4d31640 1 --2- 172.21.15.181:0/952562166 >> v2:172.21.15.42:3300/0 conn(0x7fa9e006f1d0 0x7fa9e00ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9e4d31640 1 -- 172.21.15.181:0/952562166 >> v1:172.21.15.181:6789/0 conn(0x7fa9e00ca560 legacy=0x7fa9e00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.866+0000 7fa9e4d31640 1 -- 172.21.15.181:0/952562166 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e0161140 con 0x7fa9e006d230 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.867+0000 7fa9e4d31640 1 --2- 172.21.15.181:0/952562166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e006d230 0x7fa9e01675e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8c26e7726be83e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.867+0000 7fa9deffd640 1 -- 172.21.15.181:0/952562166 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8007740 con 0x7fa9e006d230 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.867+0000 7fa9deffd640 1 -- 172.21.15.181:0/952562166 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d80078e0 con 0x7fa9e006d230 2024-05-09T01:40:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.867+0000 7fa9deffd640 1 -- 172.21.15.181:0/952562166 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8007cb0 con 0x7fa9e006d230 2024-05-09T01:40:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.867+0000 7fa9e6794640 1 -- 172.21.15.181:0/952562166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e006d230 msgr2=0x7fa9e01675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.867+0000 7fa9e6794640 1 --2- 172.21.15.181:0/952562166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e006d230 0x7fa9e01675e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d802a660 comp rx=0 tx=0).stop 2024-05-09T01:40:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.868+0000 7fa9e6794640 1 -- 172.21.15.181:0/952562166 shutdown_connections 2024-05-09T01:40:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.868+0000 7fa9e6794640 1 --2- 172.21.15.181:0/952562166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e006d230 0x7fa9e01675e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.868+0000 7fa9e6794640 1 --2- 172.21.15.181:0/952562166 >> v2:172.21.15.42:3300/0 conn(0x7fa9e006f1d0 0x7fa9e00ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.868+0000 7fa9e6794640 1 -- 172.21.15.181:0/952562166 >> 172.21.15.181:0/952562166 conn(0x7fa9e006d780 msgr2=0x7fa9e006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.868+0000 7fa9e6794640 1 -- 172.21.15.181:0/952562166 shutdown_connections 2024-05-09T01:40:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.868+0000 7fa9e6794640 1 -- 172.21.15.181:0/952562166 wait complete. 2024-05-09T01:40:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.869+0000 7fa9e6794640 1 Processor -- start 2024-05-09T01:40:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.870+0000 7fa9e6794640 1 -- start start 2024-05-09T01:40:36.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e6794640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 0x7fa9e01e8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e6794640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9e006f1d0 0x7fa9e01f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e6794640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e00ca560 0x7fa9e0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e6794640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0160660 con 0x7fa9e006f1d0 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e6794640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0160380 con 0x7fa9e006d230 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e6794640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e0160940 con 0x7fa9e00ca560 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 0x7fa9e01e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9e4d31640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e00ca560 0x7fa9e0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 0x7fa9e01e8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57746/0 (socket says 172.21.15.181:57746) 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 -- 172.21.15.181:0/3951408750 learned_addr learned my addr 172.21.15.181:0/3951408750 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9df7fe640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9e006f1d0 0x7fa9e01f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 -- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e00ca560 msgr2=0x7fa9e0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e00ca560 0x7fa9e0154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 -- 172.21.15.181:0/3951408750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9e006f1d0 msgr2=0x7fa9e01f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9e006f1d0 0x7fa9e01f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 -- 172.21.15.181:0/3951408750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e01e8db0 con 0x7fa9e006d230 2024-05-09T01:40:36.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.871+0000 7fa9dffff640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 0x7fa9e01e8870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000e870 tx=0x7fa9d000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0017070 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d000c8e0 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000ccd0 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e01f3400 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01e73d0 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9d001a070 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.872+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa9d001c870 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.873+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e006f920 con 0x7fa9e006d230 2024-05-09T01:40:36.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.875+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa9d001c450 con 0x7fa9e006d230 2024-05-09T01:40:36.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.947+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0bca03e9-6a2a-4b3b-9d2d-9d68328573e2", "id": 2} v 0) -- 0x7fa9e006dc30 con 0x7fa9e006d230 2024-05-09T01:40:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.950+0000 7fa9dcff9640 1 -- 172.21.15.181:0/3951408750 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0bca03e9-6a2a-4b3b-9d2d-9d68328573e2", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa9d001cb90 con 0x7fa9e006d230 2024-05-09T01:40:36.948 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 msgr2=0x7fa9e01e8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 0x7fa9e01e8870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000e870 tx=0x7fa9d000ed30 comp rx=0 tx=0).stop 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 shutdown_connections 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9e00ca560 0x7fa9e0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9e006f1d0 0x7fa9e01f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 --2- 172.21.15.181:0/3951408750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9e006d230 0x7fa9e01e8870 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 >> 172.21.15.181:0/3951408750 conn(0x7fa9e006d780 msgr2=0x7fa9e015e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 shutdown_connections 2024-05-09T01:40:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:36.951+0000 7fa9e6794640 1 -- 172.21.15.181:0/3951408750 wait complete. 2024-05-09T01:40:36.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 53fde253-33b1-4445-ab18-50cefa42f016 3 2024-05-09T01:40:37.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.074+0000 7f2bf5ea8640 1 Processor -- start 2024-05-09T01:40:37.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.074+0000 7f2bf5ea8640 1 -- start start 2024-05-09T01:40:37.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bf5ea8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 0x7f2bf0159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bf5ea8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2bf015db60 0x7f2bf00cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bf5ea8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 0x7f2bf00cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bf5ea8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf015d6d0 con 0x7f2bf015db60 2024-05-09T01:40:37.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bf5ea8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf00c9c90 con 0x7f2bf00cabf0 2024-05-09T01:40:37.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bf5ea8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf00cb6f0 con 0x7f2bf006fe90 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bef7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 0x7f2bf0159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2beffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 0x7f2bf00cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2beffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 0x7f2bf00cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53142/0 (socket says 172.21.15.181:53142) 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2bef7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 0x7f2bf0159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57748/0 (socket says 172.21.15.181:57748) 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2beffff640 1 -- 172.21.15.181:0/3839755988 learned_addr learned my addr 172.21.15.181:0/3839755988 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.075+0000 7f2be7fff640 1 --2- 172.21.15.181:0/3839755988 >> v2:172.21.15.42:3300/0 conn(0x7f2bf015db60 0x7f2bf00cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.076+0000 7f2beffff640 1 -- 172.21.15.181:0/3839755988 >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 msgr2=0x7f2bf0159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.076+0000 7f2beffff640 1 --2- 172.21.15.181:0/3839755988 >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 0x7f2bf0159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.076+0000 7f2beffff640 1 -- 172.21.15.181:0/3839755988 >> v2:172.21.15.42:3300/0 conn(0x7f2bf015db60 msgr2=0x7f2bf00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.076+0000 7f2beffff640 1 --2- 172.21.15.181:0/3839755988 >> v2:172.21.15.42:3300/0 conn(0x7f2bf015db60 0x7f2bf00cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.076+0000 7f2beffff640 1 -- 172.21.15.181:0/3839755988 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf0159ec0 con 0x7f2bf006fe90 2024-05-09T01:40:37.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.076+0000 7f2bef7fe640 1 --2- 172.21.15.181:0/3839755988 >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 0x7f2bf0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.077+0000 7f2beffff640 1 --2- 172.21.15.181:0/3839755988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 0x7f2bf00cf380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00cfb70 tx=0x7f2be802a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53dc220d63101d05 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.077+0000 7f2beeffd640 1 -- 172.21.15.181:0/3839755988 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8036070 con 0x7f2bf006fe90 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.077+0000 7f2beeffd640 1 -- 172.21.15.181:0/3839755988 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be8031600 con 0x7f2bf006fe90 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.077+0000 7f2beeffd640 1 -- 172.21.15.181:0/3839755988 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be80319d0 con 0x7f2bf006fe90 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/3839755988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 msgr2=0x7f2bf00cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/3839755988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 0x7f2bf00cf380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00cfb70 tx=0x7f2be802a610 comp rx=0 tx=0).stop 2024-05-09T01:40:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/3839755988 shutdown_connections 2024-05-09T01:40:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/3839755988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf006fe90 0x7f2bf00cf380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/3839755988 >> v2:172.21.15.42:3300/0 conn(0x7f2bf015db60 0x7f2bf00cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/3839755988 >> v2:172.21.15.181:3300/0 conn(0x7f2bf00cabf0 0x7f2bf0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/3839755988 >> 172.21.15.181:0/3839755988 conn(0x7f2bf006d780 msgr2=0x7f2bf006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/3839755988 shutdown_connections 2024-05-09T01:40:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.078+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/3839755988 wait complete. 2024-05-09T01:40:37.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.079+0000 7f2bf5ea8640 1 Processor -- start 2024-05-09T01:40:37.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.080+0000 7f2bf5ea8640 1 -- start start 2024-05-09T01:40:37.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bf5ea8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf006fe90 0x7f2bf014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bf5ea8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 0x7f2bf01563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bf5ea8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bf015db60 0x7f2bf0156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bf5ea8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf015d080 con 0x7f2bf006fe90 2024-05-09T01:40:37.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bf5ea8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf00cb410 con 0x7f2bf015db60 2024-05-09T01:40:37.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bf5ea8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf015d360 con 0x7f2bf00cabf0 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 0x7f2bf01563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 0x7f2bf01563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53156/0 (socket says 172.21.15.181:53156) 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2beffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bf015db60 0x7f2bf0156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 -- 172.21.15.181:0/2520739677 learned_addr learned my addr 172.21.15.181:0/2520739677 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2bef7fe640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf006fe90 0x7f2bf014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 -- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bf015db60 msgr2=0x7f2bf0156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bf015db60 0x7f2bf0156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 -- 172.21.15.181:0/2520739677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf006fe90 msgr2=0x7f2bf014dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf006fe90 0x7f2bf014dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 -- 172.21.15.181:0/2520739677 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf00bca30 con 0x7f2bf00cabf0 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2beffff640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bf015db60 0x7f2bf0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2be7fff640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 0x7f2bf01563e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800e830 tx=0x7f2bd800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.081+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8017070 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd800c940 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf015cad0 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800ccf0 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf00cea00 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2bd801a070 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2bd801c8e0 con 0x7f2bf00cabf0 2024-05-09T01:40:37.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.082+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf006f1d0 con 0x7f2bf00cabf0 2024-05-09T01:40:37.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.087+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2bf006f1d0 con 0x7f2bf00cabf0 2024-05-09T01:40:37.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.160+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "53fde253-33b1-4445-ab18-50cefa42f016", "id": 3} v 0) -- 0x7f2bf0150c40 con 0x7f2bf00cabf0 2024-05-09T01:40:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2becff9640 1 -- 172.21.15.181:0/2520739677 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53fde253-33b1-4445-ab18-50cefa42f016", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f2bd801cc00 con 0x7f2bf00cabf0 2024-05-09T01:40:37.161 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 msgr2=0x7f2bf01563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 0x7f2bf01563e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800e830 tx=0x7f2bd800ecf0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 shutdown_connections 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bf015db60 0x7f2bf0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bf00cabf0 0x7f2bf01563e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 --2- 172.21.15.181:0/2520739677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf006fe90 0x7f2bf014dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 >> 172.21.15.181:0/2520739677 conn(0x7f2bf006d780 msgr2=0x7f2bf014fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 shutdown_connections 2024-05-09T01:40:37.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.164+0000 7f2bf5ea8640 1 -- 172.21.15.181:0/2520739677 wait complete. 2024-05-09T01:40:37.173 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new f2372e04-7e6b-40b1-bf07-e817048445d7 4 2024-05-09T01:40:37.221 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.224+0000 7f6d7d770040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T01:40:37.249 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.252+0000 7f57077dc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T01:40:37.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.286+0000 7fdb08c0c640 1 Processor -- start 2024-05-09T01:40:37.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.286+0000 7fdb08c0c640 1 -- start start 2024-05-09T01:40:37.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb08c0c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdb0406d230 0x7fdb040cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb08c0c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdb040cb3b0 0x7fdb040cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb08c0c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb040c9990 con 0x7fdb0406f1d0 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb08c0c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0415d6e0 con 0x7fdb040cb3b0 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb08c0c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0415dbf0 con 0x7fdb0406d230 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdb0406d230 0x7fdb040cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdb0406d230 0x7fdb040cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57764/0 (socket says 172.21.15.181:57764) 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 -- 172.21.15.181:0/1923979321 learned_addr learned my addr 172.21.15.181:0/1923979321 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb02d9d640 1 --2- 172.21.15.181:0/1923979321 >> v2:172.21.15.42:3300/0 conn(0x7fdb040cb3b0 0x7fdb040cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 -- 172.21.15.181:0/1923979321 >> v2:172.21.15.42:3300/0 conn(0x7fdb040cb3b0 msgr2=0x7fdb040cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 --2- 172.21.15.181:0/1923979321 >> v2:172.21.15.42:3300/0 conn(0x7fdb040cb3b0 0x7fdb040cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 -- 172.21.15.181:0/1923979321 >> v1:172.21.15.181:6789/0 conn(0x7fdb0406f1d0 legacy=0x7fdb040ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb01d9b640 1 -- 172.21.15.181:0/1923979321 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb04161140 con 0x7fdb0406d230 2024-05-09T01:40:37.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.288+0000 7fdb02d9d640 1 --2- 172.21.15.181:0/1923979321 >> v2:172.21.15.42:3300/0 conn(0x7fdb040cb3b0 0x7fdb040cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:40:37.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.289+0000 7fdb01d9b640 1 --2- 172.21.15.181:0/1923979321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406d230 0x7fdb040cee40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdb040cfc30 tx=0x7fdaf402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e472b20e3a485e83 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.289+0000 7fdb0159a640 1 -- 172.21.15.181:0/1923979321 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4004030 con 0x7fdb0406d230 2024-05-09T01:40:37.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.289+0000 7fdb0159a640 1 -- 172.21.15.181:0/1923979321 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf40041d0 con 0x7fdb0406d230 2024-05-09T01:40:37.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.289+0000 7fdb0159a640 1 -- 172.21.15.181:0/1923979321 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4003610 con 0x7fdb0406d230 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 -- 172.21.15.181:0/1923979321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406d230 msgr2=0x7fdb040cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/1923979321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406d230 0x7fdb040cee40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdb040cfc30 tx=0x7fdaf402a270 comp rx=0 tx=0).stop 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 -- 172.21.15.181:0/1923979321 shutdown_connections 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/1923979321 >> v2:172.21.15.42:3300/0 conn(0x7fdb040cb3b0 0x7fdb040cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/1923979321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406d230 0x7fdb040cee40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 -- 172.21.15.181:0/1923979321 >> 172.21.15.181:0/1923979321 conn(0x7fdb0406d780 msgr2=0x7fdb0406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 -- 172.21.15.181:0/1923979321 shutdown_connections 2024-05-09T01:40:37.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.290+0000 7fdb08c0c640 1 -- 172.21.15.181:0/1923979321 wait complete. 2024-05-09T01:40:37.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.292+0000 7fdb08c0c640 1 Processor -- start 2024-05-09T01:40:37.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.292+0000 7fdb08c0c640 1 -- start start 2024-05-09T01:40:37.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb08c0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb0406d230 0x7fdb040ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb08c0c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 0x7fdb041f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb08c0c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb040cb3b0 0x7fdb04153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb08c0c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04160660 con 0x7fdb0406d230 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb08c0c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04160380 con 0x7fdb0406f1d0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb08c0c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdb04160940 con 0x7fdb040cb3b0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb01d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 0x7fdb041f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb02d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb040cb3b0 0x7fdb04153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb01d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 0x7fdb041f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57776/0 (socket says 172.21.15.181:57776) 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb01d9b640 1 -- 172.21.15.181:0/444860530 learned_addr learned my addr 172.21.15.181:0/444860530 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.293+0000 7fdb0259c640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb0406d230 0x7fdb040ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb01d9b640 1 -- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb040cb3b0 msgr2=0x7fdb04153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb01d9b640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb040cb3b0 0x7fdb04153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb01d9b640 1 -- 172.21.15.181:0/444860530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb0406d230 msgr2=0x7fdb040ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb01d9b640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb0406d230 0x7fdb040ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb01d9b640 1 -- 172.21.15.181:0/444860530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb04153c70 con 0x7fdb0406f1d0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb02d9d640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb040cb3b0 0x7fdb04153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb01d9b640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 0x7fdb041f3070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4034040 tx=0x7fdaf40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4041020 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4003c50 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4004030 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb041532f0 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb04152850 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdaf4044020 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.294+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fdaf403c960 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.295+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0406f920 con 0x7fdb0406f1d0 2024-05-09T01:40:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.297+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdaf404b030 con 0x7fdb0406f1d0 2024-05-09T01:40:37.313 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.316+0000 7f6d7d770040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T01:40:37.341 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.344+0000 7f57077dc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T01:40:37.358 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.361+0000 7f6d7d770040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T01:40:37.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.370+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f2372e04-7e6b-40b1-bf07-e817048445d7", "id": 4} v 0) -- 0x7fdb0415f9a0 con 0x7fdb0406f1d0 2024-05-09T01:40:37.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.373+0000 7fdaf2ffd640 1 -- 172.21.15.181:0/444860530 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2372e04-7e6b-40b1-bf07-e817048445d7", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fdaf403cc00 con 0x7fdb0406f1d0 2024-05-09T01:40:37.371 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-05-09T01:40:37.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 msgr2=0x7fdb041f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 0x7fdb041f3070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4034040 tx=0x7fdaf40046c0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 shutdown_connections 2024-05-09T01:40:37.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb040cb3b0 0x7fdb04153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0406f1d0 0x7fdb041f3070 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 --2- 172.21.15.181:0/444860530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb0406d230 0x7fdb040ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 >> 172.21.15.181:0/444860530 conn(0x7fdb0406d780 msgr2=0x7fdb040c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 shutdown_connections 2024-05-09T01:40:37.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.374+0000 7fdb08c0c640 1 -- 172.21.15.181:0/444860530 wait complete. 2024-05-09T01:40:37.383 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new fdb409ac-0fdc-4e82-b65e-b5968c0daaa6 5 2024-05-09T01:40:37.387 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.390+0000 7f57077dc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T01:40:37.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.496+0000 7fd054f72640 1 Processor -- start 2024-05-09T01:40:37.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.496+0000 7fd054f72640 1 -- start start 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.497+0000 7fd054f72640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd0500cabf0 0x7fd050159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.497+0000 7fd054f72640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 0x7fd0500cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.497+0000 7fd054f72640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0500c9c90 con 0x7fd05006fe90 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.497+0000 7fd054f72640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd05015d6d0 con 0x7fd0500cabf0 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.497+0000 7fd054f72640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500cb6f0 con 0x7fd05015db60 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 0x7fd0500cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 0x7fd0500cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53178/0 (socket says 172.21.15.181:53178) 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 -- 172.21.15.181:0/3044733740 learned_addr learned my addr 172.21.15.181:0/3044733740 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04e59c640 1 --2- 172.21.15.181:0/3044733740 >> v2:172.21.15.42:3300/0 conn(0x7fd0500cabf0 0x7fd050159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 -- 172.21.15.181:0/3044733740 >> v2:172.21.15.42:3300/0 conn(0x7fd0500cabf0 msgr2=0x7fd050159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 --2- 172.21.15.181:0/3044733740 >> v2:172.21.15.42:3300/0 conn(0x7fd0500cabf0 0x7fd050159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 -- 172.21.15.181:0/3044733740 >> v1:172.21.15.42:6789/0 conn(0x7fd05006fe90 legacy=0x7fd0500cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.498+0000 7fd04dd9b640 1 -- 172.21.15.181:0/3044733740 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd050159ec0 con 0x7fd05015db60 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.499+0000 7fd04dd9b640 1 --2- 172.21.15.181:0/3044733740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 0x7fd0500cee40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd038009850 tx=0x7fd03802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb036732ad05d36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.499+0000 7fd04d59a640 1 -- 172.21.15.181:0/3044733740 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038004030 con 0x7fd05015db60 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.499+0000 7fd04d59a640 1 -- 172.21.15.181:0/3044733740 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0380041d0 con 0x7fd05015db60 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.499+0000 7fd04d59a640 1 -- 172.21.15.181:0/3044733740 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038003610 con 0x7fd05015db60 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 -- 172.21.15.181:0/3044733740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 msgr2=0x7fd0500cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 --2- 172.21.15.181:0/3044733740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 0x7fd0500cee40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd038009850 tx=0x7fd03802a1a0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 -- 172.21.15.181:0/3044733740 shutdown_connections 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 --2- 172.21.15.181:0/3044733740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd05015db60 0x7fd0500cee40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 --2- 172.21.15.181:0/3044733740 >> v2:172.21.15.42:3300/0 conn(0x7fd0500cabf0 0x7fd050159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 -- 172.21.15.181:0/3044733740 >> 172.21.15.181:0/3044733740 conn(0x7fd05006d780 msgr2=0x7fd05006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 -- 172.21.15.181:0/3044733740 shutdown_connections 2024-05-09T01:40:37.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.500+0000 7fd054f72640 1 -- 172.21.15.181:0/3044733740 wait complete. 2024-05-09T01:40:37.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.502+0000 7fd054f72640 1 Processor -- start 2024-05-09T01:40:37.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.502+0000 7fd054f72640 1 -- start start 2024-05-09T01:40:37.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd054f72640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd05006fe90 0x7fd05006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd054f72640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 0x7fd05014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd054f72640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05015db60 0x7fd05015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd054f72640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015d080 con 0x7fd05015db60 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd054f72640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500cb410 con 0x7fd05006fe90 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd054f72640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd05015d360 con 0x7fd0500cabf0 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd04dd9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 0x7fd05014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd04e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd05006fe90 0x7fd05006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd04dd9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 0x7fd05014f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53182/0 (socket says 172.21.15.181:53182) 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd04dd9b640 1 -- 172.21.15.181:0/2216877472 learned_addr learned my addr 172.21.15.181:0/2216877472 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.503+0000 7fd04ed9d640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05015db60 0x7fd05015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04dd9b640 1 -- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd05006fe90 msgr2=0x7fd05006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04dd9b640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd05006fe90 0x7fd05006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04dd9b640 1 -- 172.21.15.181:0/2216877472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05015db60 msgr2=0x7fd05015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04dd9b640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05015db60 0x7fd05015b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04dd9b640 1 -- 172.21.15.181:0/2216877472 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd050157680 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04e59c640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd05006fe90 0x7fd05006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd04dd9b640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 0x7fd05014f930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd03802a1e0 tx=0x7fd0380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038041020 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd038003c50 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038004030 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd050158e30 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501590f0 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd038044020 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.504+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd03803c9d0 con 0x7fd0500cabf0 2024-05-09T01:40:37.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.505+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05006a6b0 con 0x7fd0500cabf0 2024-05-09T01:40:37.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.507+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd05006a6b0 con 0x7fd0500cabf0 2024-05-09T01:40:37.534 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.536+0000 7f6d7d770040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T01:40:37.564 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.567+0000 7f57077dc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T01:40:37.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.580+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fdb409ac-0fdc-4e82-b65e-b5968c0daaa6", "id": 5} v 0) -- 0x7fd0500c9e90 con 0x7fd0500cabf0 2024-05-09T01:40:37.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.584+0000 7fd046ffd640 1 -- 172.21.15.181:0/2216877472 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fdb409ac-0fdc-4e82-b65e-b5968c0daaa6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd03804b030 con 0x7fd0500cabf0 2024-05-09T01:40:37.582 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 msgr2=0x7fd05014f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 0x7fd05014f930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd03802a1e0 tx=0x7fd0380046c0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 shutdown_connections 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05015db60 0x7fd05015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0500cabf0 0x7fd05014f930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 --2- 172.21.15.181:0/2216877472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd05006fe90 0x7fd05006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 >> 172.21.15.181:0/2216877472 conn(0x7fd05006d780 msgr2=0x7fd050071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 shutdown_connections 2024-05-09T01:40:37.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.585+0000 7fd054f72640 1 -- 172.21.15.181:0/2216877472 wait complete. 2024-05-09T01:40:37.584 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.587+0000 7f6d7d770040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T01:40:37.594 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 2c37ceb2-34b9-478c-a1ad-7100c6fc78d4 6 2024-05-09T01:40:37.623 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.626+0000 7f57077dc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T01:40:37.639 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.642+0000 7f6d7d770040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T01:40:37.679 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.682+0000 7f57077dc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T01:40:37.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.737+0000 7f5ffe172640 1 Processor -- start 2024-05-09T01:40:37.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.737+0000 7f5ffe172640 1 -- start start 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ffe172640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff81652d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ffe172640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff80cad50 con 0x7f5ff80c8170 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ffe172640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff80cb030 con 0x7f5ff80745d0 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ffe172640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff8153e60 con 0x7f5ff8153a50 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ff7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff81652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ff6ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5ff80745d0 0x7f5ff80cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49990/0 (socket says 172.21.15.181:49990) 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ff6ffd640 1 -- 172.21.15.181:0/3710526241 learned_addr learned my addr 172.21.15.181:0/3710526241 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ff7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff81652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53184/0 (socket says 172.21.15.181:53184) 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ff67fc640 1 -- 172.21.15.181:0/3710526241 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170125918 0 0) 0x7f5ff80cb030 con 0x7f5ff80745d0 2024-05-09T01:40:37.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.738+0000 7f5ff7fff640 1 -- 172.21.15.181:0/3710526241 >> v1:172.21.15.181:6789/0 conn(0x7f5ff80745d0 legacy=0x7f5ff80cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.739+0000 7f5ff7fff640 1 -- 172.21.15.181:0/3710526241 >> v1:172.21.15.42:6789/0 conn(0x7f5ff80c8170 legacy=0x7f5ff80c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.739+0000 7f5ff7fff640 1 -- 172.21.15.181:0/3710526241 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80cb310 con 0x7f5ff8153a50 2024-05-09T01:40:37.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.739+0000 7f5ff7fff640 1 --2- 172.21.15.181:0/3710526241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff81652d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009dc0 tx=0x7f5ff002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df062d2620e735e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.739+0000 7f5ff67fc640 1 -- 172.21.15.181:0/3710526241 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff002ae60 con 0x7f5ff8153a50 2024-05-09T01:40:37.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.739+0000 7f5ff67fc640 1 -- 172.21.15.181:0/3710526241 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0007740 con 0x7f5ff8153a50 2024-05-09T01:40:37.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.739+0000 7f5ff67fc640 1 -- 172.21.15.181:0/3710526241 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0007b10 con 0x7f5ff8153a50 2024-05-09T01:40:37.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 -- 172.21.15.181:0/3710526241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 msgr2=0x7f5ff81652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 --2- 172.21.15.181:0/3710526241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff81652d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009dc0 tx=0x7f5ff002a640 comp rx=0 tx=0).stop 2024-05-09T01:40:37.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 -- 172.21.15.181:0/3710526241 shutdown_connections 2024-05-09T01:40:37.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 --2- 172.21.15.181:0/3710526241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff81652d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 -- 172.21.15.181:0/3710526241 >> 172.21.15.181:0/3710526241 conn(0x7f5ff8071750 msgr2=0x7f5ff8071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 -- 172.21.15.181:0/3710526241 shutdown_connections 2024-05-09T01:40:37.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.740+0000 7f5ffe172640 1 -- 172.21.15.181:0/3710526241 wait complete. 2024-05-09T01:40:37.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.742+0000 7f5ffe172640 1 Processor -- start 2024-05-09T01:40:37.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.742+0000 7f5ffe172640 1 -- start start 2024-05-09T01:40:37.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ffe172640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ff80745d0 0x7f5ff81f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ffe172640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ff80c8170 0x7f5ff8156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ffe172640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ffe172640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80c6850 con 0x7f5ff80745d0 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ffe172640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80c6570 con 0x7f5ff80c8170 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ffe172640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80c92f0 con 0x7f5ff8153a50 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ff7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ff6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ff80c8170 0x7f5ff8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ff7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff80cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53194/0 (socket says 172.21.15.181:53194) 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ff7fff640 1 -- 172.21.15.181:0/2659991419 learned_addr learned my addr 172.21.15.181:0/2659991419 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.743+0000 7f5ff77fe640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ff80745d0 0x7f5ff81f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff7fff640 1 -- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ff80c8170 msgr2=0x7f5ff8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff7fff640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ff80c8170 0x7f5ff8156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff7fff640 1 -- 172.21.15.181:0/2659991419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ff80745d0 msgr2=0x7f5ff81f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff7fff640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ff80745d0 0x7f5ff81f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff7fff640 1 -- 172.21.15.181:0/2659991419 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff81f3690 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff6ffd640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ff80c8170 0x7f5ff8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ff7fff640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff80cf310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009ee0 tx=0x7f5ff0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff003f070 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff002ae60 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff81568c0 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0044460 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff8154900 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ff0044600 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.744+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5ff003ba00 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.745+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff81577b0 con 0x7f5ff8153a50 2024-05-09T01:40:37.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.747+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5ff81577b0 con 0x7f5ff8153a50 2024-05-09T01:40:37.758 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:37.760+0000 7f6d7d770040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T01:40:37.800 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:37.803+0000 7f57077dc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T01:40:37.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.820+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c37ceb2-34b9-478c-a1ad-7100c6fc78d4", "id": 6} v 0) -- 0x7f5ff8152e00 con 0x7f5ff8153a50 2024-05-09T01:40:37.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.824+0000 7f5fdffff640 1 -- 172.21.15.181:0/2659991419 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c37ceb2-34b9-478c-a1ad-7100c6fc78d4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5ff003bce0 con 0x7f5ff8153a50 2024-05-09T01:40:37.821 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.824+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 msgr2=0x7f5ff80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.824+0000 7f5ffe172640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff80cf310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009ee0 tx=0x7f5ff0004a40 comp rx=0 tx=0).stop 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 shutdown_connections 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ff8153a50 0x7f5ff80cf310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ff80c8170 0x7f5ff8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 --2- 172.21.15.181:0/2659991419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ff80745d0 0x7f5ff81f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 >> 172.21.15.181:0/2659991419 conn(0x7f5ff8071750 msgr2=0x7f5ff8157990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 shutdown_connections 2024-05-09T01:40:37.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.825+0000 7f5ffe172640 1 -- 172.21.15.181:0/2659991419 wait complete. 2024-05-09T01:40:37.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 7490a851-8fcd-4c64-a656-af5d3d91e8da 7 2024-05-09T01:40:37.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.946+0000 7f2c40701640 1 Processor -- start 2024-05-09T01:40:37.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.946+0000 7f2c40701640 1 -- start start 2024-05-09T01:40:37.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c40701640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2c38153a50 0x7f2c381652d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c40701640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c380cad50 con 0x7f2c380745d0 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c40701640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c380cb030 con 0x7f2c380c8170 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c40701640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2c38153e60 con 0x7f2c38153a50 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c3ec9e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2c38153a50 0x7f2c381652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c3ec9e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2c38153a50 0x7f2c381652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57810/0 (socket says 172.21.15.181:57810) 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c3ec9e640 1 -- 172.21.15.181:0/181577613 learned_addr learned my addr 172.21.15.181:0/181577613 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c3ec9e640 1 -- 172.21.15.181:0/181577613 >> v1:172.21.15.181:6789/0 conn(0x7f2c380c8170 legacy=0x7f2c380c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c3ec9e640 1 -- 172.21.15.181:0/181577613 >> v1:172.21.15.42:6789/0 conn(0x7f2c380745d0 legacy=0x7f2c380cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.949+0000 7f2c3ec9e640 1 -- 172.21.15.181:0/181577613 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c380cb310 con 0x7f2c38153a50 2024-05-09T01:40:37.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.950+0000 7f2c3ec9e640 1 --2- 172.21.15.181:0/181577613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c38153a50 0x7f2c381652d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009e50 tx=0x7f2c3002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f2ee735e3f659f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.950+0000 7f2c3d49b640 1 -- 172.21.15.181:0/181577613 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30036070 con 0x7f2c38153a50 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.950+0000 7f2c3d49b640 1 -- 172.21.15.181:0/181577613 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c30031600 con 0x7f2c38153a50 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.950+0000 7f2c3d49b640 1 -- 172.21.15.181:0/181577613 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300319d0 con 0x7f2c38153a50 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 -- 172.21.15.181:0/181577613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c38153a50 msgr2=0x7f2c381652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 --2- 172.21.15.181:0/181577613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c38153a50 0x7f2c381652d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009e50 tx=0x7f2c3002a730 comp rx=0 tx=0).stop 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 -- 172.21.15.181:0/181577613 shutdown_connections 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 --2- 172.21.15.181:0/181577613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c38153a50 0x7f2c381652d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 -- 172.21.15.181:0/181577613 >> 172.21.15.181:0/181577613 conn(0x7f2c38071750 msgr2=0x7f2c38071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 -- 172.21.15.181:0/181577613 shutdown_connections 2024-05-09T01:40:37.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.951+0000 7f2c40701640 1 -- 172.21.15.181:0/181577613 wait complete. 2024-05-09T01:40:37.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.952+0000 7f2c40701640 1 Processor -- start 2024-05-09T01:40:37.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.953+0000 7f2c40701640 1 -- start start 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c40701640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 0x7f2c3815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c40701640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 0x7f2c3814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c40701640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c38153a50 0x7f2c380cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c40701640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380c6850 con 0x7f2c38153a50 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c40701640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380c6570 con 0x7f2c380c8170 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c40701640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2c380c92f0 con 0x7f2c380745d0 2024-05-09T01:40:37.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 0x7f2c3815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3dc9c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 0x7f2c3814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 0x7f2c3815c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:53208/0 (socket says 172.21.15.181:53208) 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 -- 172.21.15.181:0/2139416512 learned_addr learned my addr 172.21.15.181:0/2139416512 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3dc9c640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 0x7f2c3814cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57814/0 (socket says 172.21.15.181:57814) 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3ec9e640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c38153a50 0x7f2c380cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 -- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 msgr2=0x7f2c3814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 0x7f2c3814cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 -- 172.21.15.181:0/2139416512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c38153a50 msgr2=0x7f2c380cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c38153a50 0x7f2c380cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 -- 172.21.15.181:0/2139416512 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3815c870 con 0x7f2c380745d0 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3dc9c640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 0x7f2c3814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.954+0000 7f2c3e49d640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 0x7f2c3815c330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c430 tx=0x7f2c2800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:37.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28017070 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c280052d0 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3814d470 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28003830 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c381f0040 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c2801a070 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.955+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f2c28011ae0 con 0x7f2c380745d0 2024-05-09T01:40:37.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.956+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c380c5d60 con 0x7f2c380745d0 2024-05-09T01:40:37.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:37.958+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2c28021020 con 0x7f2c380745d0 2024-05-09T01:40:38.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.030+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7490a851-8fcd-4c64-a656-af5d3d91e8da", "id": 7} v 0) -- 0x7f2c380008d0 con 0x7f2c380745d0 2024-05-09T01:40:38.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.034+0000 7f2c2effd640 1 -- 172.21.15.181:0/2139416512 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7490a851-8fcd-4c64-a656-af5d3d91e8da", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f2c28011d30 con 0x7f2c380745d0 2024-05-09T01:40:38.031 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-05-09T01:40:38.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 msgr2=0x7f2c3815c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 0x7f2c3815c330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c430 tx=0x7f2c2800c8f0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 shutdown_connections 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c38153a50 0x7f2c380cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c380c8170 0x7f2c3814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 --2- 172.21.15.181:0/2139416512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c380745d0 0x7f2c3815c330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 >> 172.21.15.181:0/2139416512 conn(0x7f2c38071750 msgr2=0x7f2c38159390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 shutdown_connections 2024-05-09T01:40:38.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-09T01:40:38.035+0000 7f2c40701640 1 -- 172.21.15.181:0/2139416512 wait complete. 2024-05-09T01:40:38.043 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T01:40:38.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T01:40:38.046 INFO:tasks.ceph.osd.0:Started 2024-05-09T01:40:38.046 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T01:40:38.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T01:40:38.048 INFO:tasks.ceph.osd.1:Started 2024-05-09T01:40:38.048 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T01:40:38.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T01:40:38.050 INFO:tasks.ceph.osd.2:Started 2024-05-09T01:40:38.050 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T01:40:38.050 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T01:40:38.052 INFO:tasks.ceph.osd.3:Started 2024-05-09T01:40:38.052 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T01:40:38.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T01:40:38.055 INFO:tasks.ceph.osd.4:Started 2024-05-09T01:40:38.055 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T01:40:38.055 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T01:40:38.057 INFO:tasks.ceph.osd.5:Started 2024-05-09T01:40:38.057 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T01:40:38.057 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T01:40:38.059 INFO:tasks.ceph.osd.6:Started 2024-05-09T01:40:38.059 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T01:40:38.059 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T01:40:38.062 INFO:tasks.ceph.osd.7:Started 2024-05-09T01:40:38.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:40:38.211 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:38.213+0000 7f6d7d770040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T01:40:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.221+0000 7f923227e640 1 Processor -- start 2024-05-09T01:40:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.221+0000 7f923227e640 1 -- start start 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f923227e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f922c157060 0x7f922c1686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f923227e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c161260 con 0x7f922c0c9ec0 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f923227e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c0712c0 con 0x7f922c160d20 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f923227e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f922c15dd40 con 0x7f922c157060 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f922b7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f922c0c9ec0 0x7f922c06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:39350/0 (socket says 172.21.15.42:39350) 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f922b7fe640 1 -- 172.21.15.42:0/627704449 learned_addr learned my addr 172.21.15.42:0/627704449 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.222+0000 7f923081b640 1 --2- 172.21.15.42:0/627704449 >> v2:172.21.15.181:3300/0 conn(0x7f922c157060 0x7f922c1686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.223+0000 7f922affd640 1 -- 172.21.15.42:0/627704449 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339983306 0 0) 0x7f922c161260 con 0x7f922c0c9ec0 2024-05-09T01:40:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.223+0000 7f922affd640 1 -- 172.21.15.42:0/627704449 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9214003520 con 0x7f922c0c9ec0 2024-05-09T01:40:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.223+0000 7f923081b640 1 -- 172.21.15.42:0/627704449 >> v1:172.21.15.181:6789/0 conn(0x7f922c160d20 legacy=0x7f922c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.223+0000 7f923081b640 1 -- 172.21.15.42:0/627704449 >> v1:172.21.15.42:6789/0 conn(0x7f922c0c9ec0 legacy=0x7f922c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.223+0000 7f923081b640 1 -- 172.21.15.42:0/627704449 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c0715a0 con 0x7f922c157060 2024-05-09T01:40:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.224+0000 7f923081b640 1 --2- 172.21.15.42:0/627704449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c157060 0x7f922c1686b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9224009d90 tx=0x7f922402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c07a7fa5d2bdec43 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.224+0000 7f922affd640 1 -- 172.21.15.42:0/627704449 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9224007740 con 0x7f922c157060 2024-05-09T01:40:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.224+0000 7f922affd640 1 -- 172.21.15.42:0/627704449 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92240078e0 con 0x7f922c157060 2024-05-09T01:40:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.224+0000 7f922affd640 1 -- 172.21.15.42:0/627704449 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9224007cb0 con 0x7f922c157060 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.224+0000 7f923227e640 1 -- 172.21.15.42:0/627704449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c157060 msgr2=0x7f922c1686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.224+0000 7f923227e640 1 --2- 172.21.15.42:0/627704449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c157060 0x7f922c1686b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9224009d90 tx=0x7f922402a660 comp rx=0 tx=0).stop 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.225+0000 7f923227e640 1 -- 172.21.15.42:0/627704449 shutdown_connections 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.225+0000 7f923227e640 1 --2- 172.21.15.42:0/627704449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c157060 0x7f922c1686b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.225+0000 7f923227e640 1 -- 172.21.15.42:0/627704449 >> 172.21.15.42:0/627704449 conn(0x7f922c06ddb0 msgr2=0x7f922c0cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.225+0000 7f923227e640 1 -- 172.21.15.42:0/627704449 shutdown_connections 2024-05-09T01:40:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.225+0000 7f923227e640 1 -- 172.21.15.42:0/627704449 wait complete. 2024-05-09T01:40:38.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.226+0000 7f923227e640 1 Processor -- start 2024-05-09T01:40:38.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.227+0000 7f923227e640 1 -- start start 2024-05-09T01:40:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923227e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0c9ec0 0x7f922c1f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923227e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c157060 0x7f922c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923227e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 0x7f922c0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923227e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f922c15d1a0 con 0x7f922c160d20 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923227e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f922c157470 con 0x7f922c0c9ec0 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923227e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f922c15ce30 con 0x7f922c157060 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 0x7f922c0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 0x7f922c0cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45650/0 (socket says 172.21.15.42:45650) 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 -- 172.21.15.42:0/302072680 learned_addr learned my addr 172.21.15.42:0/302072680 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f922b7fe640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c157060 0x7f922c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f922bfff640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0c9ec0 0x7f922c1f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 -- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c157060 msgr2=0x7f922c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c157060 0x7f922c0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 -- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0c9ec0 msgr2=0x7f922c1f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0c9ec0 0x7f922c1f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f923081b640 1 -- 172.21.15.42:0/302072680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c1f6f50 con 0x7f922c160d20 2024-05-09T01:40:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.228+0000 7f922b7fe640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c157060 0x7f922c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.229+0000 7f923081b640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 0x7f922c0cadb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f922402ac50 tx=0x7f9224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.229+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922403f070 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.229+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9224031bc0 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.229+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c0ce080 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.229+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9224009450 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.229+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c0cdac0 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.230+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9224044460 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.230+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f922403a3a0 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.230+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c0cd540 con 0x7f922c160d20 2024-05-09T01:40:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.232+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f922c0cd540 con 0x7f922c160d20 2024-05-09T01:40:38.234 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:38.237+0000 7f57077dc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T01:40:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.295+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f922c072400 con 0x7f922c160d20 2024-05-09T01:40:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.295+0000 7f9228ff9640 1 -- 172.21.15.42:0/302072680 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9224007840 con 0x7f922c160d20 2024-05-09T01:40:38.293 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:38.293 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:40:38.032315+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.296+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 msgr2=0x7f922c0cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.296+0000 7f923227e640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 0x7f922c0cadb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f922402ac50 tx=0x7f9224004a40 comp rx=0 tx=0).stop 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.296+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 shutdown_connections 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.297+0000 7f923227e640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922c160d20 0x7f922c0cadb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.297+0000 7f923227e640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c157060 0x7f922c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.297+0000 7f923227e640 1 --2- 172.21.15.42:0/302072680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0c9ec0 0x7f922c1f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.297+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 >> 172.21.15.42:0/302072680 conn(0x7f922c06ddb0 msgr2=0x7f922c1547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.297+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 shutdown_connections 2024-05-09T01:40:38.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:38.297+0000 7f923227e640 1 -- 172.21.15.42:0/302072680 wait complete. 2024-05-09T01:40:38.305 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T01:40:38.305 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T01:40:38.359 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:38.362+0000 7f6d7d770040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T01:40:38.372 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:38.375+0000 7f57077dc040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T01:40:38.630 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:38.632+0000 7f57077dc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T01:40:38.634 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:38.637+0000 7f6d7d770040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T01:40:38.674 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-09T01:40:38.676+0000 7fdc3b41c640 -1 Falling back to public interface 2024-05-09T01:40:38.681 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-09T01:40:38.683+0000 7f62f673e640 -1 Falling back to public interface 2024-05-09T01:40:38.683 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:38.686+0000 7f57077dc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T01:40:38.683 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-09T01:40:38.686+0000 7fcf62e0f640 -1 Falling back to public interface 2024-05-09T01:40:38.685 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-09T01:40:38.688+0000 7f96f73cb640 -1 Falling back to public interface 2024-05-09T01:40:38.687 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-09T01:40:38.690+0000 7f484d353640 -1 Falling back to public interface 2024-05-09T01:40:38.691 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:38.694+0000 7f6d7d770040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T01:40:38.691 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-09T01:40:38.694+0000 7f89e5318640 -1 Falling back to public interface 2024-05-09T01:40:38.706 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-09T01:40:38.709+0000 7f480a01e640 -1 Falling back to public interface 2024-05-09T01:40:38.723 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-09T01:40:38.725+0000 7f0d3ae9a640 -1 Falling back to public interface 2024-05-09T01:40:38.805 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:38.808+0000 7f57077dc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T01:40:38.817 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:38.820+0000 7f6d7d770040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T01:40:39.093 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.096+0000 7f57077dc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T01:40:39.111 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T01:40:39.122 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.124+0000 7f6d7d770040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T01:40:39.141 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.144+0000 7f57077dc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T01:40:39.173 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.176+0000 7f6d7d770040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T01:40:39.217 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.220+0000 7f87c8c9a640 1 Processor -- start 2024-05-09T01:40:39.218 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.220+0000 7f87c8c9a640 1 -- start start 2024-05-09T01:40:39.219 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.221+0000 7f87c8c9a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87c406de30 0x7f87c41539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:39.219 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.221+0000 7f87c8c9a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f87c40c9d30 0x7f87c40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:39.219 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.221+0000 7f87c8c9a640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c41598b0 con 0x7f87c4074800 2024-05-09T01:40:39.219 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.221+0000 7f87c8c9a640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f87c415a1c0 con 0x7f87c406de30 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.221+0000 7f87c8c9a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f87c40cbe40 con 0x7f87c40c9d30 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.221+0000 7f87c259c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87c406de30 0x7f87c41539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87c2d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f87c4074800 0x7f87c415cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:39366/0 (socket says 172.21.15.42:39366) 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87c2d9d640 1 -- 172.21.15.42:0/3752370843 learned_addr learned my addr 172.21.15.42:0/3752370843 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87bbfff640 1 --2- 172.21.15.42:0/3752370843 >> v2:172.21.15.181:3300/0 conn(0x7f87c40c9d30 0x7f87c40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87c259c640 1 -- 172.21.15.42:0/3752370843 >> v2:172.21.15.181:3300/0 conn(0x7f87c40c9d30 msgr2=0x7f87c40742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87c259c640 1 --2- 172.21.15.42:0/3752370843 >> v2:172.21.15.181:3300/0 conn(0x7f87c40c9d30 0x7f87c40742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87c259c640 1 -- 172.21.15.42:0/3752370843 >> v1:172.21.15.42:6789/0 conn(0x7f87c4074800 legacy=0x7f87c415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:39.220 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.222+0000 7f87c259c640 1 -- 172.21.15.42:0/3752370843 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c4159b70 con 0x7f87c406de30 2024-05-09T01:40:39.221 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.223+0000 7f87c259c640 1 --2- 172.21.15.42:0/3752370843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c406de30 0x7f87c41539b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f87c40c8dc0 tx=0x7f87b402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f685ffcdd4b8e2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.223+0000 7f87c1d9b640 1 -- 172.21.15.42:0/3752370843 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4037070 con 0x7f87c406de30 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.223+0000 7f87c1d9b640 1 -- 172.21.15.42:0/3752370843 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b4032440 con 0x7f87c406de30 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.223+0000 7f87c1d9b640 1 -- 172.21.15.42:0/3752370843 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4032810 con 0x7f87c406de30 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 -- 172.21.15.42:0/3752370843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c406de30 msgr2=0x7f87c41539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/3752370843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c406de30 0x7f87c41539b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f87c40c8dc0 tx=0x7f87b402a1a0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 -- 172.21.15.42:0/3752370843 shutdown_connections 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/3752370843 >> v2:172.21.15.181:3300/0 conn(0x7f87c40c9d30 0x7f87c40742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/3752370843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c406de30 0x7f87c41539b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 -- 172.21.15.42:0/3752370843 >> 172.21.15.42:0/3752370843 conn(0x7f87c40ced30 msgr2=0x7f87c40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 -- 172.21.15.42:0/3752370843 shutdown_connections 2024-05-09T01:40:39.222 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.224+0000 7f87c8c9a640 1 -- 172.21.15.42:0/3752370843 wait complete. 2024-05-09T01:40:39.223 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.226+0000 7f87c8c9a640 1 Processor -- start 2024-05-09T01:40:39.223 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.226+0000 7f87c8c9a640 1 -- start start 2024-05-09T01:40:39.226 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c8c9a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c406de30 0x7f87c4155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:39.226 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c8c9a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c4074800 0x7f87c41f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:39.226 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c8c9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 0x7f87c414f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c8c9a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40c9100 con 0x7f87c40c9d30 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c8c9a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40c5810 con 0x7f87c406de30 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c8c9a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87c40c9280 con 0x7f87c4074800 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 0x7f87c414f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c406de30 0x7f87c4155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 0x7f87c414f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45672/0 (socket says 172.21.15.42:45672) 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 -- 172.21.15.42:0/1713352981 learned_addr learned my addr 172.21.15.42:0/1713352981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87bbfff640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c4074800 0x7f87c41f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 -- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c4074800 msgr2=0x7f87c41f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c4074800 0x7f87c41f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 -- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c406de30 msgr2=0x7f87c4155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c406de30 0x7f87c4155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c2d9d640 1 -- 172.21.15.42:0/1713352981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c4156360 con 0x7f87c40c9d30 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.227+0000 7f87c259c640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c406de30 0x7f87c4155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:39.227 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87c2d9d640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 0x7f87c414f310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00caa0 tx=0x7f87bc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc017070 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc00ac00 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c41f30d0 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc012400 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c41531e0 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f87bc01a070 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.228+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f87bc01cde0 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.229+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c406a680 con 0x7f87c40c9d30 2024-05-09T01:40:39.228 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.231+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f87bc01c710 con 0x7f87c40c9d30 2024-05-09T01:40:39.291 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.294+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87c4152c20 con 0x7f87c40c9d30 2024-05-09T01:40:39.292 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.295+0000 7f87baffd640 1 -- 172.21.15.42:0/1713352981 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f87bc01c8f0 con 0x7f87c40c9d30 2024-05-09T01:40:39.292 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-09T01:40:39.292 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":10,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:40:38.032315+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:40:39.293 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 msgr2=0x7f87c414f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:39.293 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 0x7f87c414f310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00caa0 tx=0x7f87bc00cf60 comp rx=0 tx=0).stop 2024-05-09T01:40:39.293 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 shutdown_connections 2024-05-09T01:40:39.293 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c40c9d30 0x7f87c414f310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.294 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c4074800 0x7f87c41f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.294 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 --2- 172.21.15.42:0/1713352981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c406de30 0x7f87c4155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:39.294 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 >> 172.21.15.42:0/1713352981 conn(0x7f87c40ced30 msgr2=0x7f87c41501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:39.294 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 shutdown_connections 2024-05-09T01:40:39.294 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:39.296+0000 7f87c8c9a640 1 -- 172.21.15.42:0/1713352981 wait complete. 2024-05-09T01:40:39.299 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.302+0000 7f57077dc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T01:40:39.303 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T01:40:39.344 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.346+0000 7f6d7d770040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T01:40:39.436 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.438+0000 7f57077dc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T01:40:39.485 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.488+0000 7f57077dc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T01:40:39.488 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.491+0000 7f6d7d770040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T01:40:39.541 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.544+0000 7f6d7d770040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T01:40:39.557 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.559+0000 7f57077dc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T01:40:39.602 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:39.604+0000 7f57077dc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T01:40:39.615 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.618+0000 7f6d7d770040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T01:40:39.663 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:39.666+0000 7f6d7d770040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T01:40:40.081 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:40.084+0000 7f57077dc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T01:40:40.170 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:40.173+0000 7f6d7d770040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T01:40:40.196 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:40.198+0000 7f57077dc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T01:40:40.297 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-09T01:40:40.299+0000 7f6d7d770040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T01:40:41.212 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:41.214+0000 7f56a7a2c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T01:40:41.212 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-09T01:40:41.215+0000 7f56a7a2c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T01:40:42.119 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-09T01:40:42.122+0000 7fdc3b41c640 -1 osd.3 0 log_to_monitors true 2024-05-09T01:40:42.158 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-09T01:40:42.161+0000 7f96f73cb640 -1 osd.0 0 log_to_monitors true 2024-05-09T01:40:42.177 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-09T01:40:42.180+0000 7f62f673e640 -1 osd.4 0 log_to_monitors true 2024-05-09T01:40:42.186 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-09T01:40:42.189+0000 7f484d353640 -1 osd.1 0 log_to_monitors true 2024-05-09T01:40:42.213 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-09T01:40:42.216+0000 7f0d3ae9a640 -1 osd.2 0 log_to_monitors true 2024-05-09T01:40:42.226 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-09T01:40:42.229+0000 7f89e5318640 -1 osd.6 0 log_to_monitors true 2024-05-09T01:40:42.226 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-09T01:40:42.229+0000 7f480a01e640 -1 osd.5 0 log_to_monitors true 2024-05-09T01:40:42.227 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-09T01:40:42.229+0000 7fcf62e0f640 -1 osd.7 0 log_to_monitors true 2024-05-09T01:40:44.103 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-09T01:40:44.106+0000 7f62f26d4640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T01:40:44.121 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-09T01:40:44.124+0000 7f62ea4cf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:44.523 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-09T01:40:44.525+0000 7f96f3361640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T01:40:44.526 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-09T01:40:44.528+0000 7fdc36e59640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T01:40:44.538 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-09T01:40:44.541+0000 7f96eb15c640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:44.541 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-09T01:40:44.544+0000 7fdc2ec54640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:44.570 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-09T01:40:44.573+0000 7f48492e9640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T01:40:44.580 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-09T01:40:44.583+0000 7f48410e4640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:45.180 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-09T01:40:45.183+0000 7f0d36e30640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T01:40:45.199 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-09T01:40:45.202+0000 7f0d2ec2b640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:45.912 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-09T01:40:45.914+0000 7fcf5e7ff640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T01:40:45.925 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-09T01:40:45.927+0000 7fcf565fa640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:45.936 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-09T01:40:45.939+0000 7f480590c640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T01:40:45.950 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-09T01:40:45.953+0000 7f47fd718640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:45.967 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-09T01:40:45.969+0000 7f89e12ae640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T01:40:45.985 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-09T01:40:45.988+0000 7f89d90a9640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T01:40:46.110 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T01:40:46.231 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.234+0000 7f6370d1c640 1 Processor -- start 2024-05-09T01:40:46.231 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.234+0000 7f6370d1c640 1 -- start start 2024-05-09T01:40:46.234 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6370d1c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f636c156f80 0x7f636c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:46.234 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6370d1c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c160180 0x7f636c160590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:46.234 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6370d1c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c0c9330 con 0x7f636c0cbe70 2024-05-09T01:40:46.234 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6370d1c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f636c0c9100 con 0x7f636c156f80 2024-05-09T01:40:46.234 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6370d1c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f636c0c9c40 con 0x7f636c160180 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6369d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f636c156f80 0x7f636c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6369d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f636c156f80 0x7f636c0731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45722/0 (socket says 172.21.15.42:45722) 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f6369d9b640 1 -- 172.21.15.42:0/1482893307 learned_addr learned my addr 172.21.15.42:0/1482893307 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.235+0000 7f636ad9d640 1 --2- 172.21.15.42:0/1482893307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c160180 0x7f636c160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.236+0000 7f6369d9b640 1 -- 172.21.15.42:0/1482893307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c160180 msgr2=0x7f636c160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.236+0000 7f6369d9b640 1 --2- 172.21.15.42:0/1482893307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c160180 0x7f636c160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.236+0000 7f6369d9b640 1 -- 172.21.15.42:0/1482893307 >> v1:172.21.15.181:6789/0 conn(0x7f636c0cbe70 legacy=0x7f636c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.236+0000 7f6369d9b640 1 -- 172.21.15.42:0/1482893307 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c160eb0 con 0x7f636c156f80 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.237+0000 7f6369d9b640 1 --2- 172.21.15.42:0/1482893307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c0731b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6354009870 tx=0x7f635402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf1c67bd677614 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.237+0000 7f636959a640 1 -- 172.21.15.42:0/1482893307 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037070 con 0x7f636c156f80 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.237+0000 7f636959a640 1 -- 172.21.15.42:0/1482893307 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354032440 con 0x7f636c156f80 2024-05-09T01:40:46.235 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.237+0000 7f636959a640 1 -- 172.21.15.42:0/1482893307 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354032810 con 0x7f636c156f80 2024-05-09T01:40:46.236 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.237+0000 7f6370d1c640 1 -- 172.21.15.42:0/1482893307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 msgr2=0x7f636c0731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:46.236 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.237+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1482893307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c0731b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6354009870 tx=0x7f635402a270 comp rx=0 tx=0).stop 2024-05-09T01:40:46.237 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.238+0000 7f6370d1c640 1 -- 172.21.15.42:0/1482893307 shutdown_connections 2024-05-09T01:40:46.237 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.238+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1482893307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c160180 0x7f636c160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.237 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.238+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1482893307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c0731b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.237 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.238+0000 7f6370d1c640 1 -- 172.21.15.42:0/1482893307 >> 172.21.15.42:0/1482893307 conn(0x7f636c0ced30 msgr2=0x7f636c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:46.238 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.238+0000 7f6370d1c640 1 -- 172.21.15.42:0/1482893307 shutdown_connections 2024-05-09T01:40:46.238 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.238+0000 7f6370d1c640 1 -- 172.21.15.42:0/1482893307 wait complete. 2024-05-09T01:40:46.243 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.240+0000 7f6370d1c640 1 Processor -- start 2024-05-09T01:40:46.243 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.240+0000 7f6370d1c640 1 -- start start 2024-05-09T01:40:46.243 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6370d1c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c0cbe70 0x7f636c1f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6370d1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c1f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6370d1c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636c160180 0x7f636c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6370d1c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0ca0d0 con 0x7f636c156f80 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6370d1c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f636c06e070 con 0x7f636c160180 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6370d1c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f636c160ad0 con 0x7f636c0cbe70 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c1f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c1f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45738/0 (socket says 172.21.15.42:45738) 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 -- 172.21.15.42:0/1085301049 learned_addr learned my addr 172.21.15.42:0/1085301049 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:46.244 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f636ad9d640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636c160180 0x7f636c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f636a59c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c0cbe70 0x7f636c1f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 -- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c0cbe70 msgr2=0x7f636c1f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c0cbe70 0x7f636c1f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 -- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636c160180 msgr2=0x7f636c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636c160180 0x7f636c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.241+0000 7f6369d9b640 1 -- 172.21.15.42:0/1085301049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c1f3900 con 0x7f636c156f80 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f636ad9d640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636c160180 0x7f636c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:46.245 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f6369d9b640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c1f33c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6354000c00 tx=0x7f63540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037040 con 0x7f636c156f80 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354042070 con 0x7f636c156f80 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c15a460 con 0x7f636c156f80 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354030880 con 0x7f636c156f80 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.242+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c1f3b10 con 0x7f636c156f80 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.243+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c06a680 con 0x7f636c156f80 2024-05-09T01:40:46.246 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.244+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f6354030a20 con 0x7f636c156f80 2024-05-09T01:40:46.247 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.245+0000 7f6362ffd640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f634c076270 0x7f634c078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:46.247 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.245+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3631+0+0 (secure 0 0 0) 0x7f63540b7310 con 0x7f636c156f80 2024-05-09T01:40:46.247 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.245+0000 7f636a59c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f634c076270 0x7f634c078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:46.247 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.245+0000 7f636a59c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f634c076270 0x7f634c078780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f635c0012e0 tx=0x7f635c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:46.248 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.250+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6354080fb0 con 0x7f636c156f80 2024-05-09T01:40:46.443 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.445+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f636c0c7a20 con 0x7f636c156f80 2024-05-09T01:40:46.443 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.446+0000 7f6362ffd640 1 -- 172.21.15.42:0/1085301049 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9486 (secure 0 0 0) 0x7f63540852b0 con 0x7f636c156f80 2024-05-09T01:40:46.444 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-09T01:40:46.444 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":14,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:40:45.229794+0000","last_up_change":"2024-05-09T01:40:45.229794+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:40:46.446 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f634c076270 msgr2=0x7f634c078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:46.446 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f634c076270 0x7f634c078780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f635c0012e0 tx=0x7f635c009040 comp rx=0 tx=0).stop 2024-05-09T01:40:46.446 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 msgr2=0x7f636c1f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:46.446 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c1f33c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6354000c00 tx=0x7f63540046c0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.446 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 shutdown_connections 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f634c076270 0x7f634c078780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636c160180 0x7f636c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f636c156f80 0x7f636c1f33c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 --2- 172.21.15.42:0/1085301049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f636c0cbe70 0x7f636c1f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 >> 172.21.15.42:0/1085301049 conn(0x7f636c0ced30 msgr2=0x7f636c0cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 shutdown_connections 2024-05-09T01:40:46.447 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:46.448+0000 7f6370d1c640 1 -- 172.21.15.42:0/1085301049 wait complete. 2024-05-09T01:40:46.456 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-05-09T01:40:53.263 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T01:40:53.382 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.384+0000 7f2b72005640 1 Processor -- start 2024-05-09T01:40:53.382 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.384+0000 7f2b72005640 1 -- start start 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b72005640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c070150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b72005640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2b6c0cc410 0x7f2b6c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b72005640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b6c06eb20 0x7f2b6c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b72005640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6c0caed0 con 0x7f2b6c0cc410 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b72005640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6c15e1f0 con 0x7f2b6c06eb20 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b72005640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c06d8a0 con 0x7f2b6c0cb230 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2b6c0cc410 0x7f2b6c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2b6c0cc410 0x7f2b6c15dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45654/0 (socket says 172.21.15.42:45654) 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 -- 172.21.15.42:0/1416964086 learned_addr learned my addr 172.21.15.42:0/1416964086 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/1416964086 >> v2:172.21.15.181:3300/0 conn(0x7f2b6c06eb20 0x7f2b6c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6b7fe640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 -- 172.21.15.42:0/1416964086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 msgr2=0x7f2b6c070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 -- 172.21.15.42:0/1416964086 >> v2:172.21.15.181:3300/0 conn(0x7f2b6c06eb20 msgr2=0x7f2b6c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 --2- 172.21.15.42:0/1416964086 >> v2:172.21.15.181:3300/0 conn(0x7f2b6c06eb20 0x7f2b6c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6affd640 1 -- 172.21.15.42:0/1416964086 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c06db80 con 0x7f2b6c0cc410 2024-05-09T01:40:53.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.386+0000 7f2b6b7fe640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:40:53.386 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.387+0000 7f2b6affd640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c15dcb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c074a70 tx=0x7f2b6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afd41e945f1a276 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.387+0000 7f2b6a7fc640 1 -- 172.21.15.42:0/1416964086 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60037070 con 0x7f2b6c0cc410 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.387+0000 7f2b6a7fc640 1 -- 172.21.15.42:0/1416964086 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b60032440 con 0x7f2b6c0cc410 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.387+0000 7f2b6a7fc640 1 -- 172.21.15.42:0/1416964086 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60032810 con 0x7f2b6c0cc410 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 -- 172.21.15.42:0/1416964086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 msgr2=0x7f2b6c15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c15dcb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c074a70 tx=0x7f2b6002a270 comp rx=0 tx=0).stop 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 -- 172.21.15.42:0/1416964086 shutdown_connections 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 --2- 172.21.15.42:0/1416964086 >> v2:172.21.15.181:3300/0 conn(0x7f2b6c06eb20 0x7f2b6c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c15dcb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 --2- 172.21.15.42:0/1416964086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 -- 172.21.15.42:0/1416964086 >> 172.21.15.42:0/1416964086 conn(0x7f2b6c0691b0 msgr2=0x7f2b6c0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 -- 172.21.15.42:0/1416964086 shutdown_connections 2024-05-09T01:40:53.387 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.388+0000 7f2b72005640 1 -- 172.21.15.42:0/1416964086 wait complete. 2024-05-09T01:40:53.388 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.390+0000 7f2b72005640 1 Processor -- start 2024-05-09T01:40:53.388 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.390+0000 7f2b72005640 1 -- start start 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.391+0000 7f2b72005640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6c06eb20 0x7f2b6c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.391+0000 7f2b72005640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.391+0000 7f2b72005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b72005640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c0b5930 con 0x7f2b6c0cc410 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b72005640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c06e600 con 0x7f2b6c06eb20 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b72005640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c0cab70 con 0x7f2b6c0cb230 2024-05-09T01:40:53.390 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c14e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45664/0 (socket says 172.21.15.42:45664) 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 -- 172.21.15.42:0/969768227 learned_addr learned my addr 172.21.15.42:0/969768227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6b7fe640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6c06eb20 0x7f2b6c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6affd640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c14e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 -- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 msgr2=0x7f2b6c14e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c14e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 -- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6c06eb20 msgr2=0x7f2b6c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6c06eb20 0x7f2b6c0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 -- 172.21.15.42:0/969768227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c0c7d40 con 0x7f2b6c0cc410 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c14e540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b64007d10 tx=0x7f2b6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64014420 con 0x7f2b6c0cc410 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b64019070 con 0x7f2b6c0cc410 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64014800 con 0x7f2b6c0cc410 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.392+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c0ce260 con 0x7f2b6c0cc410 2024-05-09T01:40:53.391 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.393+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c0c9030 con 0x7f2b6c0cc410 2024-05-09T01:40:53.392 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.394+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6c06df80 con 0x7f2b6c0cc410 2024-05-09T01:40:53.392 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.394+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b640149a0 con 0x7f2b6c0cc410 2024-05-09T01:40:53.392 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.395+0000 7f2b53fff640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b580762d0 0x7f2b580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.393 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.395+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2b64097a30 con 0x7f2b6c0cc410 2024-05-09T01:40:53.393 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.395+0000 7f2b6b7fe640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b580762d0 0x7f2b580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.393 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.396+0000 7f2b6b7fe640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b580762d0 0x7f2b580787e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00aac0 tx=0x7f2b5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:53.397 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.400+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b6c06df80 con 0x7f2b6c0cc410 2024-05-09T01:40:53.589 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.591+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b6c06a680 con 0x7f2b6c0cc410 2024-05-09T01:40:53.589 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.592+0000 7f2b53fff640 1 -- 172.21.15.42:0/969768227 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f2b64060f60 con 0x7f2b6c0cc410 2024-05-09T01:40:53.590 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-09T01:40:53.590 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":17,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:40:48.921857+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:40:53.592 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b580762d0 msgr2=0x7f2b580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.592 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b580762d0 0x7f2b580787e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00aac0 tx=0x7f2b5c008040 comp rx=0 tx=0).stop 2024-05-09T01:40:53.592 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 msgr2=0x7f2b6c14e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c14e540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b64007d10 tx=0x7f2b6400e4b0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 shutdown_connections 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b580762d0 0x7f2b580787e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c0cc410 0x7f2b6c14e540 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b6c0cb230 0x7f2b6c14e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 --2- 172.21.15.42:0/969768227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6c06eb20 0x7f2b6c0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 >> 172.21.15.42:0/969768227 conn(0x7f2b6c0691b0 msgr2=0x7f2b6c075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 shutdown_connections 2024-05-09T01:40:53.593 INFO:teuthology.misc.health.smithi042.stderr:2024-05-09T01:40:53.595+0000 7f2b72005640 1 -- 172.21.15.42:0/969768227 wait complete. 2024-05-09T01:40:53.602 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T01:40:53.602 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T01:40:53.602 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T01:40:53.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T01:40:53.605 INFO:tasks.ceph.mds.a:Started 2024-05-09T01:40:53.605 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T01:40:53.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T01:40:53.608 INFO:tasks.ceph.mds.c:Started 2024-05-09T01:40:53.608 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-09T01:40:53.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-09T01:40:53.610 INFO:tasks.ceph.mds.e:Started 2024-05-09T01:40:53.610 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T01:40:53.610 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T01:40:53.613 INFO:tasks.ceph.mds.b:Started 2024-05-09T01:40:53.613 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T01:40:53.613 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T01:40:53.616 INFO:tasks.ceph.mds.d:Started 2024-05-09T01:40:53.616 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-09T01:40:53.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-09T01:40:53.618 INFO:tasks.ceph.mds.f:Started 2024-05-09T01:40:53.618 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T01:40:53.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:40:53.699 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-05-09T01:40:53.702 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-05-09T01:40:53.705 INFO:tasks.ceph.mds.e.smithi042.stdout:starting mds.e at 2024-05-09T01:40:53.717 INFO:tasks.ceph.mds.f.smithi181.stdout:starting mds.f at 2024-05-09T01:40:53.718 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-05-09T01:40:53.719 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-05-09T01:40:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.749+0000 7ff513429640 1 Processor -- start 2024-05-09T01:40:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.749+0000 7ff513429640 1 -- start start 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff513429640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff50c0cb2f0 0x7ff50c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff513429640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c15b6f0 con 0x7ff50c1634d0 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff513429640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c15b9d0 con 0x7ff50c0cc710 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff513429640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c15e430 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff5111c5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff50c0cb2f0 0x7ff50c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff5111c5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff50c0cb2f0 0x7ff50c0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45730/0 (socket says 172.21.15.42:45730) 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff5111c5640 1 -- 172.21.15.42:0/1603463431 learned_addr learned my addr 172.21.15.42:0/1603463431 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff503fff640 1 -- 172.21.15.42:0/1603463431 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998470313 0 0) 0x7ff50c15b6f0 con 0x7ff50c1634d0 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff503fff640 1 -- 172.21.15.42:0/1603463431 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f8003520 con 0x7ff50c1634d0 2024-05-09T01:40:53.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff5111c5640 1 -- 172.21.15.42:0/1603463431 >> v1:172.21.15.181:6789/0 conn(0x7ff50c0cc710 legacy=0x7ff50c0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff5111c5640 1 -- 172.21.15.42:0/1603463431 >> v1:172.21.15.42:6789/0 conn(0x7ff50c1634d0 legacy=0x7ff50c1658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.751+0000 7ff5111c5640 1 -- 172.21.15.42:0/1603463431 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c15e710 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.752+0000 7ff5111c5640 1 --2- 172.21.15.42:0/1603463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c0c5410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff508009870 tx=0x7ff50802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12f100e2cd5872a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.752+0000 7ff503fff640 1 -- 172.21.15.42:0/1603463431 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508037070 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.752+0000 7ff503fff640 1 -- 172.21.15.42:0/1603463431 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff508032640 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.752+0000 7ff503fff640 1 -- 172.21.15.42:0/1603463431 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508032a10 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 -- 172.21.15.42:0/1603463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 msgr2=0x7ff50c0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 --2- 172.21.15.42:0/1603463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c0c5410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff508009870 tx=0x7ff50802a3c0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 -- 172.21.15.42:0/1603463431 shutdown_connections 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 --2- 172.21.15.42:0/1603463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c0c5410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 -- 172.21.15.42:0/1603463431 >> 172.21.15.42:0/1603463431 conn(0x7ff50c072890 msgr2=0x7ff50c072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 -- 172.21.15.42:0/1603463431 shutdown_connections 2024-05-09T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.753+0000 7ff513429640 1 -- 172.21.15.42:0/1603463431 wait complete. 2024-05-09T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.755+0000 7ff513429640 1 Processor -- start 2024-05-09T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.755+0000 7ff513429640 1 -- start start 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.756+0000 7ff513429640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.756+0000 7ff513429640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff50c0cc710 0x7ff50c1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.756+0000 7ff513429640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff50c1634d0 0x7ff50c144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff513429640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c154f90 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff513429640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c15e120 con 0x7ff50c0cc710 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff513429640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c0cc0e0 con 0x7ff50c1634d0 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c14cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45736/0 (socket says 172.21.15.42:45736) 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 -- 172.21.15.42:0/1831063116 learned_addr learned my addr 172.21.15.42:0/1831063116 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5119c6640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff50c1634d0 0x7ff50c144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5109c4640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff50c0cc710 0x7ff50c1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 -- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff50c1634d0 msgr2=0x7ff50c144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff50c1634d0 0x7ff50c144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 -- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff50c0cc710 msgr2=0x7ff50c1589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff50c0cc710 0x7ff50c1589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 -- 172.21.15.42:0/1831063116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c148cf0 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5109c4640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff50c0cc710 0x7ff50c1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff5111c5640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c14cec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff50802a400 tx=0x7ff5080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508037040 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff508042070 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c1483c0 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.757+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5080309b0 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.758+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c0cee10 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.759+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c0b3220 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.760+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff508030b50 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.760+0000 7ff501ffb640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff4f00762d0 0x7ff4f00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:53.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.760+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff5080b8500 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.761+0000 7ff5109c4640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff4f00762d0 0x7ff4f00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:53.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.761+0000 7ff5109c4640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff4f00762d0 0x7ff4f00787e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff50c15a480 tx=0x7ff4fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:53.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.764+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff508082320 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.994+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff50c0cbe50 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.995+0000 7ff501ffb640 1 -- 172.21.15.42:0/1831063116 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7ff508081c20 con 0x7ff50c0cb2f0 2024-05-09T01:40:53.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:53.993 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T01:40:53.993 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 2 2024-05-09T01:40:53.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff4f00762d0 msgr2=0x7ff4f00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff4f00762d0 0x7ff4f00787e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff50c15a480 tx=0x7ff4fc009040 comp rx=0 tx=0).stop 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 msgr2=0x7ff50c14cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c14cec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff50802a400 tx=0x7ff5080046c0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 shutdown_connections 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff4f00762d0 0x7ff4f00787e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff50c1634d0 0x7ff50c144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff50c0cc710 0x7ff50c1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 --2- 172.21.15.42:0/1831063116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff50c0cb2f0 0x7ff50c14cec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 >> 172.21.15.42:0/1831063116 conn(0x7ff50c072890 msgr2=0x7ff50c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 shutdown_connections 2024-05-09T01:40:53.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:53.997+0000 7ff513429640 1 -- 172.21.15.42:0/1831063116 wait complete. 2024-05-09T01:40:56.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:40:56.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.137+0000 7f1582053640 1 Processor -- start 2024-05-09T01:40:56.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.137+0000 7f1582053640 1 -- start start 2024-05-09T01:40:56.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f1582053640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f157c0c9500 0x7f157c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f1582053640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f1582053640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f157c160420 con 0x7f157c0c9a80 2024-05-09T01:40:56.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f1582053640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f157c1612f0 con 0x7f157c0c9500 2024-05-09T01:40:56.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f1582053640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f157c0cc350 con 0x7f157c0b7ba0 2024-05-09T01:40:56.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:36810/0 (socket says 172.21.15.42:36810) 2024-05-09T01:40:56.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157affd640 1 -- 172.21.15.42:0/802073793 learned_addr learned my addr 172.21.15.42:0/802073793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:56.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157b7fe640 1 --2- 172.21.15.42:0/802073793 >> v2:172.21.15.181:3300/0 conn(0x7f157c0c9500 0x7f157c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157a7fc640 1 -- 172.21.15.42:0/802073793 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567743082 0 0) 0x7f157c160420 con 0x7f157c0c9a80 2024-05-09T01:40:56.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157a7fc640 1 -- 172.21.15.42:0/802073793 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1564003520 con 0x7f157c0c9a80 2024-05-09T01:40:56.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157b7fe640 1 -- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 msgr2=0x7f157c1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:56.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157b7fe640 1 --2- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157b7fe640 1 -- 172.21.15.42:0/802073793 >> v1:172.21.15.181:6789/0 conn(0x7f157c0c9a80 legacy=0x7f157c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157b7fe640 1 -- 172.21.15.42:0/802073793 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c1606e0 con 0x7f157c0c9500 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.139+0000 7f157affd640 1 --2- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.140+0000 7f157b7fe640 1 --2- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c0ce4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f156c0097a0 tx=0x7f156c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ce2e70b160c936 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.140+0000 7f157a7fc640 1 -- 172.21.15.42:0/802073793 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c037070 con 0x7f157c0c9500 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f157a7fc640 1 -- 172.21.15.42:0/802073793 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f156c032440 con 0x7f157c0c9500 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f157a7fc640 1 -- 172.21.15.42:0/802073793 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c032810 con 0x7f157c0c9500 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 -- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 msgr2=0x7f157c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 --2- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c0ce4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f156c0097a0 tx=0x7f156c02a180 comp rx=0 tx=0).stop 2024-05-09T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 -- 172.21.15.42:0/802073793 shutdown_connections 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 --2- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 --2- 172.21.15.42:0/802073793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c0ce4b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 -- 172.21.15.42:0/802073793 >> 172.21.15.42:0/802073793 conn(0x7f157c0d2100 msgr2=0x7f157c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 -- 172.21.15.42:0/802073793 shutdown_connections 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.141+0000 7f1582053640 1 -- 172.21.15.42:0/802073793 wait complete. 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.143+0000 7f1582053640 1 Processor -- start 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.143+0000 7f1582053640 1 -- start start 2024-05-09T01:40:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.144+0000 7f1582053640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.144+0000 7f1582053640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c1f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.144+0000 7f1582053640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0c9a80 0x7f157c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.144+0000 7f1582053640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f157c160f80 con 0x7f157c0b7ba0 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.144+0000 7f1582053640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f157c160ca0 con 0x7f157c0c9500 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.144+0000 7f1582053640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f157c0caf80 con 0x7f157c0c9a80 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45744/0 (socket says 172.21.15.42:45744) 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 -- 172.21.15.42:0/2636904128 learned_addr learned my addr 172.21.15.42:0/2636904128 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157affd640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c1f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157bfff640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0c9a80 0x7f157c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 -- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0c9a80 msgr2=0x7f157c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0c9a80 0x7f157c158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 -- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 msgr2=0x7f157c1f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c1f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 -- 172.21.15.42:0/2636904128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c158fd0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f157b7fe640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f156c035040 tx=0x7f156c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c041030 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f156c03d4e0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c1582b0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c037040 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.145+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c0d1bc0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.146+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c156cd0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.147+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f156c044070 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.148+0000 7f1563fff640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1568076300 0x7f1568078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.148+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f156c0b77a0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.148+0000 7f157affd640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1568076300 0x7f1568078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.149+0000 7f157affd640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1568076300 0x7f1568078810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f157c1602e0 tx=0x7f1570008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.153+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f157c156cd0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.382+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f157c0d1dc0 con 0x7f157c0b7ba0 2024-05-09T01:40:56.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.383+0000 7f1563fff640 1 -- 172.21.15.42:0/2636904128 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7f156c04b070 con 0x7f157c0b7ba0 2024-05-09T01:40:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:56.382 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T01:40:56.382 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-05-09T01:40:56.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1568076300 msgr2=0x7f1568078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1568076300 0x7f1568078810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f157c1602e0 tx=0x7f1570008040 comp rx=0 tx=0).stop 2024-05-09T01:40:56.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 msgr2=0x7f157c1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f156c035040 tx=0x7f156c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 shutdown_connections 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1568076300 0x7f1568078810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f157c0c9a80 0x7f157c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f157c0c9500 0x7f157c1f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 --2- 172.21.15.42:0/2636904128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f157c0b7ba0 0x7f157c1570f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 >> 172.21.15.42:0/2636904128 conn(0x7f157c0d2100 msgr2=0x7f157c0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 shutdown_connections 2024-05-09T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.385+0000 7f1582053640 1 -- 172.21.15.42:0/2636904128 wait complete. 2024-05-09T01:40:56.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T01:40:56.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.516+0000 7f8c9934d640 1 Processor -- start 2024-05-09T01:40:56.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.516+0000 7f8c9934d640 1 -- start start 2024-05-09T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.517+0000 7f8c9934d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c940c6f30 0x7f8c940cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.517+0000 7f8c9934d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940caaf0 0x7f8c94160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.517+0000 7f8c9934d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c9406e320 con 0x7f8c940717e0 2024-05-09T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.517+0000 7f8c9934d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8c94073500 con 0x7f8c940c6f30 2024-05-09T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.517+0000 7f8c9934d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8c94070ab0 con 0x7f8c940caaf0 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.517+0000 7f8c8bfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c940c6f30 0x7f8c940cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c92ffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c940717e0 0x7f8c941602f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53508/0 (socket says 172.21.15.42:53508) 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c92ffd640 1 -- 172.21.15.42:0/3858653735 learned_addr learned my addr 172.21.15.42:0/3858653735 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c937fe640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940caaf0 0x7f8c94160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c8bfff640 1 -- 172.21.15.42:0/3858653735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940caaf0 msgr2=0x7f8c94160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c8bfff640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940caaf0 0x7f8c94160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c8bfff640 1 -- 172.21.15.42:0/3858653735 >> v1:172.21.15.42:6789/0 conn(0x7f8c940717e0 legacy=0x7f8c941602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c8bfff640 1 -- 172.21.15.42:0/3858653735 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9406e600 con 0x7f8c940c6f30 2024-05-09T01:40:56.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c927fc640 1 -- 172.21.15.42:0/3858653735 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860085848 0 0) 0x7f8c9406e320 con 0x7f8c940717e0 2024-05-09T01:40:56.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.518+0000 7f8c937fe640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940caaf0 0x7f8c94160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:40:56.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.519+0000 7f8c8bfff640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940c6f30 0x7f8c940cbef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009790 tx=0x7f8c7c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ef774af74529fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.519+0000 7f8c927fc640 1 -- 172.21.15.42:0/3858653735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c037070 con 0x7f8c940c6f30 2024-05-09T01:40:56.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.519+0000 7f8c927fc640 1 -- 172.21.15.42:0/3858653735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c032440 con 0x7f8c940c6f30 2024-05-09T01:40:56.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.519+0000 7f8c927fc640 1 -- 172.21.15.42:0/3858653735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c032810 con 0x7f8c940c6f30 2024-05-09T01:40:56.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.519+0000 7f8c9934d640 1 -- 172.21.15.42:0/3858653735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940c6f30 msgr2=0x7f8c940cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.519+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940c6f30 0x7f8c940cbef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009790 tx=0x7f8c7c02a210 comp rx=0 tx=0).stop 2024-05-09T01:40:56.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.520+0000 7f8c9934d640 1 -- 172.21.15.42:0/3858653735 shutdown_connections 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.520+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940caaf0 0x7f8c94160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.520+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3858653735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940c6f30 0x7f8c940cbef0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.520+0000 7f8c9934d640 1 -- 172.21.15.42:0/3858653735 >> 172.21.15.42:0/3858653735 conn(0x7f8c94068c40 msgr2=0x7f8c94072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.520+0000 7f8c9934d640 1 -- 172.21.15.42:0/3858653735 shutdown_connections 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.520+0000 7f8c9934d640 1 -- 172.21.15.42:0/3858653735 wait complete. 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.521+0000 7f8c9934d640 1 Processor -- start 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.521+0000 7f8c9934d640 1 -- start start 2024-05-09T01:40:56.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.522+0000 7f8c9934d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c940717e0 0x7f8c941f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.522+0000 7f8c9934d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940c6f30 0x7f8c940d0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c9934d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 0x7f8c94159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c9934d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94070fe0 con 0x7f8c940caaf0 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c9934d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c940c7340 con 0x7f8c940717e0 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c9934d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8c940712c0 con 0x7f8c940c6f30 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 0x7f8c94159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 0x7f8c94159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45764/0 (socket says 172.21.15.42:45764) 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 -- 172.21.15.42:0/3546187160 learned_addr learned my addr 172.21.15.42:0/3546187160 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c8bfff640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940c6f30 0x7f8c940d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c92ffd640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c940717e0 0x7f8c941f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 -- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940c6f30 msgr2=0x7f8c940d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940c6f30 0x7f8c940d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 -- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c940717e0 msgr2=0x7f8c941f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c940717e0 0x7f8c941f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 -- 172.21.15.42:0/3546187160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c941f7240 con 0x7f8c940caaf0 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c8bfff640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940c6f30 0x7f8c940d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c937fe640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 0x7f8c94159ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00cd50 tx=0x7f8c8c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00f680 con 0x7f8c940caaf0 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00f840 con 0x7f8c940caaf0 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c940b51f0 con 0x7f8c940caaf0 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00fc30 con 0x7f8c940caaf0 2024-05-09T01:40:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.523+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c94158f50 con 0x7f8c940caaf0 2024-05-09T01:40:56.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.524+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9415a4e0 con 0x7f8c940caaf0 2024-05-09T01:40:56.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.525+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c8c0213f0 con 0x7f8c940caaf0 2024-05-09T01:40:56.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.526+0000 7f8c8b7fe640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c740762d0 0x7f8c740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.526+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8c8c098070 con 0x7f8c940caaf0 2024-05-09T01:40:56.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.526+0000 7f8c92ffd640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c740762d0 0x7f8c740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.526+0000 7f8c92ffd640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c740762d0 0x7f8c740787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c84000f60 tx=0x7f8c84007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.530+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c8c014030 con 0x7f8c940caaf0 2024-05-09T01:40:56.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.725+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8c9406db40 con 0x7f8c940caaf0 2024-05-09T01:40:56.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.725+0000 7f8c8b7fe640 1 -- 172.21.15.42:0/3546187160 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f8c8c061c90 con 0x7f8c940caaf0 2024-05-09T01:40:56.723 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:40:56.723 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-05-09T01:40:56.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-09T01:40:56.724 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-05-09T01:40:56.724 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-05-09T01:40:56.724 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:40:56.724 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-05-09T01:40:56.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c740762d0 msgr2=0x7f8c740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c740762d0 0x7f8c740787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c84000f60 tx=0x7f8c84007c00 comp rx=0 tx=0).stop 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 msgr2=0x7f8c94159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 0x7f8c94159ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00cd50 tx=0x7f8c8c00a650 comp rx=0 tx=0).stop 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 shutdown_connections 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c740762d0 0x7f8c740787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c940caaf0 0x7f8c94159ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c940c6f30 0x7f8c940d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 --2- 172.21.15.42:0/3546187160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c940717e0 0x7f8c941f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 >> 172.21.15.42:0/3546187160 conn(0x7f8c94068c40 msgr2=0x7f8c94155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:56.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 shutdown_connections 2024-05-09T01:40:56.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.728+0000 7f8c9934d640 1 -- 172.21.15.42:0/3546187160 wait complete. 2024-05-09T01:40:56.737 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T01:40:56.737 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T01:40:56.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.859+0000 7fe870773640 1 Processor -- start 2024-05-09T01:40:56.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.859+0000 7fe870773640 1 -- start start 2024-05-09T01:40:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe870773640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe8680c7780 0x7fe8680cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe870773640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86815cf90 con 0x7fe8681656f0 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe870773640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8680cce10 con 0x7fe8680b4e90 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe870773640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe8680ce890 con 0x7fe8680c7780 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe86e50f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe8680c7780 0x7fe8680cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe86ed10640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe8681656f0 0x7fe868167b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53518/0 (socket says 172.21.15.42:53518) 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.860+0000 7fe86ed10640 1 -- 172.21.15.42:0/3638512693 learned_addr learned my addr 172.21.15.42:0/3638512693 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.861+0000 7fe86e50f640 1 -- 172.21.15.42:0/3638512693 >> v1:172.21.15.181:6789/0 conn(0x7fe8680b4e90 legacy=0x7fe86806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.861+0000 7fe86e50f640 1 -- 172.21.15.42:0/3638512693 >> v1:172.21.15.42:6789/0 conn(0x7fe8681656f0 legacy=0x7fe868167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.861+0000 7fe86e50f640 1 -- 172.21.15.42:0/3638512693 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8680cd0f0 con 0x7fe8680c7780 2024-05-09T01:40:56.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.861+0000 7fe86d50d640 1 -- 172.21.15.42:0/3638512693 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182604536 0 0) 0x7fe86815cf90 con 0x7fe8681656f0 2024-05-09T01:40:56.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.861+0000 7fe86e50f640 1 --2- 172.21.15.42:0/3638512693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8680c7780 0x7fe8680cd8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe864009d90 tx=0x7fe86402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3b2085debe562c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe86d50d640 1 -- 172.21.15.42:0/3638512693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864007740 con 0x7fe8680c7780 2024-05-09T01:40:56.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe86d50d640 1 -- 172.21.15.42:0/3638512693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8640078e0 con 0x7fe8680c7780 2024-05-09T01:40:56.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe86d50d640 1 -- 172.21.15.42:0/3638512693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864007cb0 con 0x7fe8680c7780 2024-05-09T01:40:56.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 -- 172.21.15.42:0/3638512693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8680c7780 msgr2=0x7fe8680cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 --2- 172.21.15.42:0/3638512693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8680c7780 0x7fe8680cd8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe864009d90 tx=0x7fe86402a660 comp rx=0 tx=0).stop 2024-05-09T01:40:56.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 -- 172.21.15.42:0/3638512693 shutdown_connections 2024-05-09T01:40:56.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 --2- 172.21.15.42:0/3638512693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8680c7780 0x7fe8680cd8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 -- 172.21.15.42:0/3638512693 >> 172.21.15.42:0/3638512693 conn(0x7fe868068e00 msgr2=0x7fe8680d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:56.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 -- 172.21.15.42:0/3638512693 shutdown_connections 2024-05-09T01:40:56.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.862+0000 7fe870773640 1 -- 172.21.15.42:0/3638512693 wait complete. 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.864+0000 7fe870773640 1 Processor -- start 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.864+0000 7fe870773640 1 -- start start 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.865+0000 7fe870773640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe8680b4e90 0x7fe8680cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.865+0000 7fe870773640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8680c7780 0x7fe86815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.865+0000 7fe870773640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 0x7fe868153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.865+0000 7fe870773640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680cd460 con 0x7fe8681656f0 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.865+0000 7fe870773640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680ccbc0 con 0x7fe8680c7780 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.865+0000 7fe870773640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe868157350 con 0x7fe8680b4e90 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 0x7fe868153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 0x7fe868153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45794/0 (socket says 172.21.15.42:45794) 2024-05-09T01:40:56.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 -- 172.21.15.42:0/796508529 learned_addr learned my addr 172.21.15.42:0/796508529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86e50f640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe8680b4e90 0x7fe8680cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86dd0e640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8680c7780 0x7fe86815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 -- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe8680b4e90 msgr2=0x7fe8680cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe8680b4e90 0x7fe8680cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 -- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8680c7780 msgr2=0x7fe86815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8680c7780 0x7fe86815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 -- 172.21.15.42:0/796508529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8681f3fd0 con 0x7fe8681656f0 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe86ed10640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 0x7fe868153b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c390 tx=0x7fe86000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8600074e0 con 0x7fe8681656f0 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8600047e0 con 0x7fe8681656f0 2024-05-09T01:40:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86815aa30 con 0x7fe8681656f0 2024-05-09T01:40:56.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860004bd0 con 0x7fe8681656f0 2024-05-09T01:40:56.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.866+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8681f34f0 con 0x7fe8681656f0 2024-05-09T01:40:56.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.867+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe868151460 con 0x7fe8681656f0 2024-05-09T01:40:56.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.868+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe860011070 con 0x7fe8681656f0 2024-05-09T01:40:56.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.869+0000 7fe85effd640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe84c0762d0 0x7fe84c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:56.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.869+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe860096d40 con 0x7fe8681656f0 2024-05-09T01:40:56.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.869+0000 7fe86e50f640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe84c0762d0 0x7fe84c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:56.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.869+0000 7fe86e50f640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe84c0762d0 0x7fe84c0787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe864034000 tx=0x7fe86402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:56.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:56.873+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe860060300 con 0x7fe8681656f0 2024-05-09T01:40:57.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.065+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe8680ce310 con 0x7fe8681656f0 2024-05-09T01:40:57.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.726+0000 7fe85effd640 1 -- 172.21.15.42:0/796508529 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fe860064600 con 0x7fe8681656f0 2024-05-09T01:40:57.724 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-05-09T01:40:57.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe84c0762d0 msgr2=0x7fe84c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe84c0762d0 0x7fe84c0787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe864034000 tx=0x7fe86402f000 comp rx=0 tx=0).stop 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 msgr2=0x7fe868153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 0x7fe868153b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c390 tx=0x7fe86000c850 comp rx=0 tx=0).stop 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 shutdown_connections 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe84c0762d0 0x7fe84c0787e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8681656f0 0x7fe868153b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8680c7780 0x7fe86815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 --2- 172.21.15.42:0/796508529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe8680b4e90 0x7fe8680cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 >> 172.21.15.42:0/796508529 conn(0x7fe868068e00 msgr2=0x7fe86814bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 shutdown_connections 2024-05-09T01:40:57.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.729+0000 7fe870773640 1 -- 172.21.15.42:0/796508529 wait complete. 2024-05-09T01:40:57.742 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T01:40:57.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.869+0000 7f49a24a7640 1 Processor -- start 2024-05-09T01:40:57.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.869+0000 7f49a24a7640 1 -- start start 2024-05-09T01:40:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f49a24a7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f499c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f49a24a7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c160420 con 0x7f499c0b7ba0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f49a24a7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c1606e0 con 0x7f499c1570f0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f49a24a7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f499c1612f0 con 0x7f499c0c9500 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f499b7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f499c0b7ba0 0x7f499c0c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45718/0 (socket says 172.21.15.42:45718) 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f499b7fe640 1 -- 172.21.15.42:0/445284112 learned_addr learned my addr 172.21.15.42:0/445284112 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f499bfff640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f499c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.870+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283465666 0 0) 0x7f499c160420 con 0x7f499c0b7ba0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4984003520 con 0x7f499c0b7ba0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178465117 0 0) 0x7f499c1606e0 con 0x7f499c1570f0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f499c160420 con 0x7f499c1570f0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2145461797 0 0) 0x7f4984003520 con 0x7f499c0b7ba0 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 msgr2=0x7f499c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f499c0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 >> v1:172.21.15.181:6789/0 conn(0x7f499c1570f0 legacy=0x7f499c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c1609c0 con 0x7f499c0b7ba0 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499bfff640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f499c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f49900016f0 con 0x7f499c0b7ba0 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 >> v1:172.21.15.42:6789/0 conn(0x7f499c0b7ba0 legacy=0x7f499c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f4984003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004210 0x7f4984004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4984004db0 0x7f4984005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1612f0 con 0x7f4984004db0 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f498400bc70 con 0x7f4984004210 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f498400be70 con 0x7f499c0c9500 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f49a0a44640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4984004db0 0x7f4984005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499b7fe640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004210 0x7f4984004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f499bfff640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f4984003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f49a0a44640 1 -- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 msgr2=0x7f4984003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f49a0a44640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c0c9500 0x7f4984003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f49a0a44640 1 -- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004210 msgr2=0x7f4984004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f49a0a44640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004210 0x7f4984004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.871+0000 7f49a0a44640 1 -- 172.21.15.42:0/445284112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984003520 con 0x7f4984004db0 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.872+0000 7f49a0a44640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4984004db0 0x7f4984005280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4994001f70 tx=0x7f4984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d877945ac37ee1d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.872+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994001bc0 con 0x7f4984004db0 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.872+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4994006d70 con 0x7f4984004db0 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.872+0000 7f499affd640 1 -- 172.21.15.42:0/445284112 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994003bb0 con 0x7f4984004db0 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a24a7640 1 -- 172.21.15.42:0/445284112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4984004db0 msgr2=0x7f4984005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a24a7640 1 --2- 172.21.15.42:0/445284112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4984004db0 0x7f4984005280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4994001f70 tx=0x7f4984005830 comp rx=0 tx=0).stop 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a0a44640 1 -- 172.21.15.42:0/445284112 reap_dead start 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a24a7640 1 -- 172.21.15.42:0/445284112 shutdown_connections 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a24a7640 1 -- 172.21.15.42:0/445284112 >> 172.21.15.42:0/445284112 conn(0x7f499c0d2100 msgr2=0x7f499c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a24a7640 1 -- 172.21.15.42:0/445284112 shutdown_connections 2024-05-09T01:40:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.873+0000 7f49a24a7640 1 -- 172.21.15.42:0/445284112 wait complete. 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.875+0000 7f49a24a7640 1 Processor -- start 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.875+0000 7f49a24a7640 1 -- start start 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a24a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004db0 0x7f499c1e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a24a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 0x7f499c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a24a7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c1f61b0 0x7f499c1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a24a7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f499c160f80 con 0x7f499c1503f0 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a24a7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f499c0cc350 con 0x7f4984004db0 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a24a7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f499c157500 con 0x7f499c1f61b0 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f499b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 0x7f499c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f499b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 0x7f499c14fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47012/0 (socket says 172.21.15.42:47012) 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f499b7fe640 1 -- 172.21.15.42:0/2968804513 learned_addr learned my addr 172.21.15.42:0/2968804513 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f499bfff640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004db0 0x7f499c1e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.876+0000 7f49a0a44640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c1f61b0 0x7f499c1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f499b7fe640 1 -- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c1f61b0 msgr2=0x7f499c1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f499b7fe640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c1f61b0 0x7f499c1f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f499b7fe640 1 -- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004db0 msgr2=0x7f499c1e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f499b7fe640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004db0 0x7f499c1e8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f499b7fe640 1 -- 172.21.15.42:0/2968804513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c1e93d0 con 0x7f499c1503f0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f499b7fe640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 0x7f499c14fb70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4990007290 tx=0x7f4990007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499000f9c0 con 0x7f499c1503f0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990018070 con 0x7f499c1503f0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c0c7210 con 0x7f499c1503f0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499000fda0 con 0x7f499c1503f0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.877+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c151a90 con 0x7f499c1503f0 2024-05-09T01:40:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.878+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499c0cbf50 con 0x7f499c1503f0 2024-05-09T01:40:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.879+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f499001d460 con 0x7f499c1503f0 2024-05-09T01:40:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.879+0000 7f4998ff9640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4988076300 0x7f4988078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.879+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f4990097f70 con 0x7f499c1503f0 2024-05-09T01:40:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.880+0000 7f499bfff640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4988076300 0x7f4988078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:57.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.880+0000 7f499bfff640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4988076300 0x7f4988078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f498c009bb0 tx=0x7f498c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:57.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:57.883+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f49900613b0 con 0x7f499c1503f0 2024-05-09T01:40:58.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.077+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f499c156ab0 con 0x7f499c1503f0 2024-05-09T01:40:58.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.732+0000 7f4998ff9640 1 -- 172.21.15.42:0/2968804513 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f49900656b0 con 0x7f499c1503f0 2024-05-09T01:40:58.730 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4988076300 msgr2=0x7f4988078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4988076300 0x7f4988078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f498c009bb0 tx=0x7f498c009190 comp rx=0 tx=0).stop 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 msgr2=0x7f499c14fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 0x7f499c14fb70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4990007290 tx=0x7f4990007750 comp rx=0 tx=0).stop 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 shutdown_connections 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4988076300 0x7f4988078810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f499c1f61b0 0x7f499c1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f499c1503f0 0x7f499c14fb70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 --2- 172.21.15.42:0/2968804513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4984004db0 0x7f499c1e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.735+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 >> 172.21.15.42:0/2968804513 conn(0x7f499c0d2100 msgr2=0x7f499c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:58.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.736+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 shutdown_connections 2024-05-09T01:40:58.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.737+0000 7f49a24a7640 1 -- 172.21.15.42:0/2968804513 wait complete. 2024-05-09T01:40:58.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T01:40:58.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.887+0000 7fa55ecee640 1 Processor -- start 2024-05-09T01:40:58.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.887+0000 7fa55ecee640 1 -- start start 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa55ecee640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa5580c4a20 0x7fa5580c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa55ecee640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5580c55d0 con 0x7fa558074940 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa55ecee640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55815cdd0 con 0x7fa558156e80 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa55ecee640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa55815db90 con 0x7fa5580c4a20 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa557fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa558074940 0x7fa55806ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45726/0 (socket says 172.21.15.42:45726) 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa557fff640 1 -- 172.21.15.42:0/2347807807 learned_addr learned my addr 172.21.15.42:0/2347807807 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:58.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926300268 0 0) 0x7fa5580c55d0 con 0x7fa558074940 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa544003520 con 0x7fa558074940 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa55d28b640 1 --2- 172.21.15.42:0/2347807807 >> v2:172.21.15.181:3300/0 conn(0x7fa5580c4a20 0x7fa5580c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016393809 0 0) 0x7fa544003520 con 0x7fa558074940 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 >> v2:172.21.15.181:3300/0 conn(0x7fa5580c4a20 msgr2=0x7fa5580c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 --2- 172.21.15.42:0/2347807807 >> v2:172.21.15.181:3300/0 conn(0x7fa5580c4a20 0x7fa5580c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 >> v1:172.21.15.181:6789/0 conn(0x7fa558156e80 legacy=0x7fa558073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55815d0b0 con 0x7fa558074940 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.889+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7fa540001a70 con 0x7fa558074940 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 >> v1:172.21.15.42:6789/0 conn(0x7fa558074940 legacy=0x7fa55806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa544003a50 0x7fa544003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa544004800 0x7fa544004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa54400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815db90 con 0x7fa544005250 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa54400c1e0 con 0x7fa544003a50 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa54400c3e0 con 0x7fa544004800 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55d28b640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa54400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55ca8a640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa544003a50 0x7fa544003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa557fff640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa544004800 0x7fa544004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55d28b640 1 -- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa544004800 msgr2=0x7fa544004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55d28b640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa544004800 0x7fa544004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55d28b640 1 -- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa544003a50 msgr2=0x7fa544003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55d28b640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa544003a50 0x7fa544003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.890+0000 7fa55d28b640 1 -- 172.21.15.42:0/2347807807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544003520 con 0x7fa544005250 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.891+0000 7fa55d28b640 1 -- 172.21.15.42:0/2347807807 reap_dead start 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.891+0000 7fa55d28b640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa54400b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa550009ac0 tx=0x7fa544005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943a837a4a341480 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.891+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550009690 con 0x7fa544005250 2024-05-09T01:40:58.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.891+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa550004020 con 0x7fa544005250 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.891+0000 7fa5577fe640 1 -- 172.21.15.42:0/2347807807 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550004410 con 0x7fa544005250 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 -- 172.21.15.42:0/2347807807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 msgr2=0x7fa54400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa54400b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa550009ac0 tx=0x7fa544005830 comp rx=0 tx=0).stop 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 -- 172.21.15.42:0/2347807807 shutdown_connections 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2347807807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa54400b9c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 -- 172.21.15.42:0/2347807807 >> 172.21.15.42:0/2347807807 conn(0x7fa5580ce7e0 msgr2=0x7fa5580cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 -- 172.21.15.42:0/2347807807 shutdown_connections 2024-05-09T01:40:58.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.892+0000 7fa55ecee640 1 -- 172.21.15.42:0/2347807807 wait complete. 2024-05-09T01:40:58.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.893+0000 7fa55ecee640 1 Processor -- start 2024-05-09T01:40:58.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.893+0000 7fa55ecee640 1 -- start start 2024-05-09T01:40:58.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ecee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa5581584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ecee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5581e4250 0x7fa55814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ecee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa558154310 0x7fa558154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ecee640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580c4e30 con 0x7fa544005250 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ecee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815d670 con 0x7fa558154310 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ecee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa5580c4fb0 con 0x7fa5581e4250 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa5581584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa5581584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47020/0 (socket says 172.21.15.42:47020) 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 -- 172.21.15.42:0/2466580068 learned_addr learned my addr 172.21.15.42:0/2466580068 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55d28b640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa558154310 0x7fa558154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa557fff640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5581e4250 0x7fa55814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 -- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5581e4250 msgr2=0x7fa55814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5581e4250 0x7fa55814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 -- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa558154310 msgr2=0x7fa558154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa558154310 0x7fa558154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 -- 172.21.15.42:0/2466580068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5581e3b70 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa557fff640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5581e4250 0x7fa55814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.895+0000 7fa55ca8a640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa5581584a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa54800f820 tx=0x7fa54800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.896+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54801a070 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.896+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa548005110 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.896+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5581e3e30 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.896+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548007050 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.896+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5581575c0 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.896+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa558074510 con 0x7fa544005250 2024-05-09T01:40:58.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.897+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa54801d070 con 0x7fa544005250 2024-05-09T01:40:58.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.898+0000 7fa5557fa640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5380762d0 0x7fa5380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:58.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.898+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fa548096d90 con 0x7fa544005250 2024-05-09T01:40:58.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.898+0000 7fa557fff640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5380762d0 0x7fa5380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:58.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.899+0000 7fa557fff640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5380762d0 0x7fa5380787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa540001330 tx=0x7fa540006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:58.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:58.903+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa548060070 con 0x7fa544005250 2024-05-09T01:40:59.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.136+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa5580c59c0 con 0x7fa544005250 2024-05-09T01:40:59.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.734+0000 7fa5557fa640 1 -- 172.21.15.42:0/2466580068 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa548064370 con 0x7fa544005250 2024-05-09T01:40:59.731 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.737+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5380762d0 msgr2=0x7fa5380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.737+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5380762d0 0x7fa5380787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa540001330 tx=0x7fa540006040 comp rx=0 tx=0).stop 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.737+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 msgr2=0x7fa5581584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.737+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa5581584a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa54800f820 tx=0x7fa54800fce0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 shutdown_connections 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5380762d0 0x7fa5380787e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa558154310 0x7fa558154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5581e4250 0x7fa55814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 --2- 172.21.15.42:0/2466580068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa544005250 0x7fa5581584a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 >> 172.21.15.42:0/2466580068 conn(0x7fa5580ce7e0 msgr2=0x7fa5580cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:59.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 shutdown_connections 2024-05-09T01:40:59.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.739+0000 7fa55ecee640 1 -- 172.21.15.42:0/2466580068 wait complete. 2024-05-09T01:40:59.765 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:40:59.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.886+0000 7f8c6ceee640 1 Processor -- start 2024-05-09T01:40:59.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.886+0000 7f8c6ceee640 1 -- start start 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c6ceee640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c680cdaa0 0x7f8c68157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c6ceee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c680ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c6ceee640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c680c7bf0 con 0x7f8c68160990 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c6ceee640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8c680c79a0 con 0x7f8c680cdaa0 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c6ceee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8c680c7ed0 con 0x7f8c680ce0d0 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c6659c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c680cdaa0 0x7f8c68157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:59.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c66d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c68160990 0x7f8c680ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45728/0 (socket says 172.21.15.42:45728) 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.887+0000 7f8c66d9d640 1 -- 172.21.15.42:0/1826511955 learned_addr learned my addr 172.21.15.42:0/1826511955 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c5dd9b640 1 --2- 172.21.15.42:0/1826511955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c680ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c65d9b640 1 -- 172.21.15.42:0/1826511955 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397112401 0 0) 0x7f8c680c7bf0 con 0x7f8c68160990 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c65d9b640 1 -- 172.21.15.42:0/1826511955 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c54003520 con 0x7f8c68160990 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c6659c640 1 -- 172.21.15.42:0/1826511955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 msgr2=0x7f8c680ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c6659c640 1 --2- 172.21.15.42:0/1826511955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c680ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c6659c640 1 -- 172.21.15.42:0/1826511955 >> v1:172.21.15.42:6789/0 conn(0x7f8c68160990 legacy=0x7f8c680ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.888+0000 7f8c6659c640 1 -- 172.21.15.42:0/1826511955 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c680c81b0 con 0x7f8c680cdaa0 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6659c640 1 --2- 172.21.15.42:0/1826511955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c68157100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c680c7b20 tx=0x7f8c5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4848ce3226c3caf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:59.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c65d9b640 1 -- 172.21.15.42:0/1826511955 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58037070 con 0x7f8c680cdaa0 2024-05-09T01:40:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c65d9b640 1 -- 172.21.15.42:0/1826511955 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58032440 con 0x7f8c680cdaa0 2024-05-09T01:40:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c65d9b640 1 -- 172.21.15.42:0/1826511955 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58032810 con 0x7f8c680cdaa0 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1826511955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 msgr2=0x7f8c68157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1826511955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c68157100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c680c7b20 tx=0x7f8c5802a180 comp rx=0 tx=0).stop 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1826511955 shutdown_connections 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1826511955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c680ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1826511955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c68157100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1826511955 >> 172.21.15.42:0/1826511955 conn(0x7f8c68068610 msgr2=0x7f8c68068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1826511955 shutdown_connections 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.889+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1826511955 wait complete. 2024-05-09T01:40:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.891+0000 7f8c6ceee640 1 Processor -- start 2024-05-09T01:40:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.892+0000 7f8c6ceee640 1 -- start start 2024-05-09T01:40:59.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6ceee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c6815fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:59.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6ceee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c6814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:59.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6ceee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68160990 0x7f8c680d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:59.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6ceee640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c68160470 con 0x7f8c680cdaa0 2024-05-09T01:40:59.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6ceee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c680c8770 con 0x7f8c68160990 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6ceee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8c680cf210 con 0x7f8c680ce0d0 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c6815fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c6815fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47046/0 (socket says 172.21.15.42:47046) 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 -- 172.21.15.42:0/1947572301 learned_addr learned my addr 172.21.15.42:0/1947572301 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c5dd9b640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c6814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c66d9d640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68160990 0x7f8c680d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 -- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 msgr2=0x7f8c6814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c6814dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 -- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68160990 msgr2=0x7f8c680d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68160990 0x7f8c680d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:40:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 -- 172.21.15.42:0/1947572301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6814e420 con 0x7f8c680cdaa0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.893+0000 7f8c6659c640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c6815fc50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.894+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58041020 con 0x7f8c680cdaa0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.894+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5803d700 con 0x7f8c680cdaa0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.894+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c681e6530 con 0x7f8c680cdaa0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.894+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58037040 con 0x7f8c680cdaa0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.894+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c681e6af0 con 0x7f8c680cdaa0 2024-05-09T01:40:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.895+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6806dab0 con 0x7f8c680cdaa0 2024-05-09T01:40:59.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.895+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c58044020 con 0x7f8c680cdaa0 2024-05-09T01:40:59.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.896+0000 7f8c5f7fe640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c48076300 0x7f8c48078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:40:59.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.896+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c580b7cc0 con 0x7f8c680cdaa0 2024-05-09T01:40:59.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.896+0000 7f8c5dd9b640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c48076300 0x7f8c48078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:40:59.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.897+0000 7f8c5dd9b640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c48076300 0x7f8c48078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c681f4430 tx=0x7f8c50009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:40:59.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:40:59.901+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c6806dab0 con 0x7f8c680cdaa0 2024-05-09T01:41:00.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.091+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c681e74d0 con 0x7f8c680cdaa0 2024-05-09T01:41:00.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.092+0000 7f8c5f7fe640 1 -- 172.21.15.42:0/1947572301 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16618 (secure 0 0 0) 0x7f8c5804b030 con 0x7f8c680cdaa0 2024-05-09T01:41:00.090 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:00.090 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:40:59.137490+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c48076300 msgr2=0x7f8c48078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c48076300 0x7f8c48078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c681f4430 tx=0x7f8c50009190 comp rx=0 tx=0).stop 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 msgr2=0x7f8c6815fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c6815fc50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c580046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 shutdown_connections 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c48076300 0x7f8c48078810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68160990 0x7f8c680d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c680ce0d0 0x7f8c6814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 --2- 172.21.15.42:0/1947572301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c680cdaa0 0x7f8c6815fc50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 >> 172.21.15.42:0/1947572301 conn(0x7f8c68068610 msgr2=0x7f8c6806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:00.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 shutdown_connections 2024-05-09T01:41:00.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.094+0000 7f8c6ceee640 1 -- 172.21.15.42:0/1947572301 wait complete. 2024-05-09T01:41:00.103 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:41:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.220+0000 7f1ed249f640 1 Processor -- start 2024-05-09T01:41:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.220+0000 7f1ed249f640 1 -- start start 2024-05-09T01:41:00.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ed249f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 0x7f1ecc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ed249f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ecc1570f0 0x7f1ecc0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ed249f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ecc160420 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ed249f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1ecc1612f0 con 0x7f1ecc1570f0 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ed249f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ecc0cc350 con 0x7f1ecc0c9500 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 0x7f1ecc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ed0a3c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ecc1570f0 0x7f1ecc0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 0x7f1ecc0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:46914/0 (socket says 172.21.15.42:46914) 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4175587585 learned_addr learned my addr 172.21.15.42:0/4175587585 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4175587585 >> v2:172.21.15.181:3300/0 conn(0x7f1ecc1570f0 msgr2=0x7f1ecc0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 --2- 172.21.15.42:0/4175587585 >> v2:172.21.15.181:3300/0 conn(0x7f1ecc1570f0 0x7f1ecc0ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4175587585 >> v1:172.21.15.181:6789/0 conn(0x7f1ecc0b7ba0 legacy=0x7f1ecc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.222+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4175587585 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc1606e0 con 0x7f1ecc0c9500 2024-05-09T01:41:00.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.223+0000 7f1ecbfff640 1 --2- 172.21.15.42:0/4175587585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 0x7f1ecc0ce4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa6fe891a86525e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.223+0000 7f1ecaffd640 1 -- 172.21.15.42:0/4175587585 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc037070 con 0x7f1ecc0c9500 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.223+0000 7f1ecaffd640 1 -- 172.21.15.42:0/4175587585 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ebc032440 con 0x7f1ecc0c9500 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.223+0000 7f1ecaffd640 1 -- 172.21.15.42:0/4175587585 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc032810 con 0x7f1ecc0c9500 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 -- 172.21.15.42:0/4175587585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 msgr2=0x7f1ecc0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4175587585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 0x7f1ecc0ce4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc02a270 comp rx=0 tx=0).stop 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 -- 172.21.15.42:0/4175587585 shutdown_connections 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4175587585 >> v2:172.21.15.181:3300/0 conn(0x7f1ecc1570f0 0x7f1ecc0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4175587585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc0c9500 0x7f1ecc0ce4b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 -- 172.21.15.42:0/4175587585 >> 172.21.15.42:0/4175587585 conn(0x7f1ecc0d2100 msgr2=0x7f1ecc0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 -- 172.21.15.42:0/4175587585 shutdown_connections 2024-05-09T01:41:00.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.224+0000 7f1ed249f640 1 -- 172.21.15.42:0/4175587585 wait complete. 2024-05-09T01:41:00.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.226+0000 7f1ed249f640 1 Processor -- start 2024-05-09T01:41:00.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.226+0000 7f1ed249f640 1 -- start start 2024-05-09T01:41:00.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ed249f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 0x7f1ecc1f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ed249f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ecc0c9500 0x7f1ecc150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ed249f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc1570f0 0x7f1ecc153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ed249f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc160f80 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ed249f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc160ca0 con 0x7f1ecc0c9500 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ed249f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ecc157500 con 0x7f1ecc1570f0 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ecbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 0x7f1ecc1f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ecbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 0x7f1ecc1f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47052/0 (socket says 172.21.15.42:47052) 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.227+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4232396981 learned_addr learned my addr 172.21.15.42:0/4232396981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ed0a3c640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc1570f0 0x7f1ecc153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecb7fe640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ecc0c9500 0x7f1ecc150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc1570f0 msgr2=0x7f1ecc153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecbfff640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc1570f0 0x7f1ecc153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ecc0c9500 msgr2=0x7f1ecc150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecbfff640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ecc0c9500 0x7f1ecc150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecbfff640 1 -- 172.21.15.42:0/4232396981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc153940 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ecbfff640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 0x7f1ecc1f6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc000c00 tx=0x7f1ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc037040 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ebc042070 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ecc14fd80 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc030860 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.228+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ecc0c63d0 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.229+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ecc0cbf50 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.230+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ebc030a00 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.230+0000 7f1ec8ff9640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1eb80762d0 0x7f1eb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.231+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1ebc0b8990 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.231+0000 7f1ecb7fe640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1eb80762d0 0x7f1eb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.231+0000 7f1ecb7fe640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1eb80762d0 0x7f1eb80787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc14fb00 tx=0x7f1ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.234+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ebc030cf0 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.426+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ecc0d00f0 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.427+0000 7f1ec8ff9640 1 -- 172.21.15.42:0/4232396981 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16618 (secure 0 0 0) 0x7f1ebc082340 con 0x7f1ecc0b7ba0 2024-05-09T01:41:00.424 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:00.425 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:40:59.137490+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:00.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1eb80762d0 msgr2=0x7f1eb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1eb80762d0 0x7f1eb80787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc14fb00 tx=0x7f1ec0009040 comp rx=0 tx=0).stop 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 msgr2=0x7f1ecc1f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 0x7f1ecc1f6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc000c00 tx=0x7f1ebc0046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 shutdown_connections 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1eb80762d0 0x7f1eb80787e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ecc1570f0 0x7f1ecc153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ecc0c9500 0x7f1ecc150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 --2- 172.21.15.42:0/4232396981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ecc0b7ba0 0x7f1ecc1f6ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 >> 172.21.15.42:0/4232396981 conn(0x7f1ecc0d2100 msgr2=0x7f1ecc0ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 shutdown_connections 2024-05-09T01:41:00.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.429+0000 7f1ed249f640 1 -- 172.21.15.42:0/4232396981 wait complete. 2024-05-09T01:41:00.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T01:41:00.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.558+0000 7f6187cee640 1 Processor -- start 2024-05-09T01:41:00.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.559+0000 7f6187cee640 1 -- start start 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6187cee640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f61800ce7a0 0x7f61800c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6187cee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61800c8f00 0x7f6180167720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6187cee640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61800c9310 con 0x7f6180157220 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6187cee640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f618015dde0 con 0x7f61800ce7a0 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6187cee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f61800c7fe0 con 0x7f61800c8f00 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185289640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f61800ce7a0 0x7f61800c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185a8a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6180157220 0x7f618006d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45742/0 (socket says 172.21.15.42:45742) 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185a8a640 1 -- 172.21.15.42:0/3622238629 learned_addr learned my addr 172.21.15.42:0/3622238629 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f618628b640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61800c8f00 0x7f6180167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185289640 1 -- 172.21.15.42:0/3622238629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61800c8f00 msgr2=0x7f6180167720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185289640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61800c8f00 0x7f6180167720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6184a88640 1 -- 172.21.15.42:0/3622238629 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417433367 0 0) 0x7f6170001490 con 0x7f6180157220 2024-05-09T01:41:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185289640 1 -- 172.21.15.42:0/3622238629 >> v1:172.21.15.42:6789/0 conn(0x7f6180157220 legacy=0x7f618006d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.560+0000 7f6185289640 1 -- 172.21.15.42:0/3622238629 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61800c7260 con 0x7f61800ce7a0 2024-05-09T01:41:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.561+0000 7f618628b640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61800c8f00 0x7f6180167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.561+0000 7f6185289640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800ce7a0 0x7f61800c89c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61740097a0 tx=0x7f617402a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c433aa9ba7403d31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.561+0000 7f6184a88640 1 -- 172.21.15.42:0/3622238629 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037070 con 0x7f61800ce7a0 2024-05-09T01:41:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.561+0000 7f6184a88640 1 -- 172.21.15.42:0/3622238629 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617402ae30 con 0x7f61800ce7a0 2024-05-09T01:41:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.561+0000 7f6184a88640 1 -- 172.21.15.42:0/3622238629 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174032640 con 0x7f61800ce7a0 2024-05-09T01:41:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 -- 172.21.15.42:0/3622238629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800ce7a0 msgr2=0x7f61800c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800ce7a0 0x7f61800c89c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61740097a0 tx=0x7f617402a0e0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 -- 172.21.15.42:0/3622238629 shutdown_connections 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61800c8f00 0x7f6180167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 --2- 172.21.15.42:0/3622238629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800ce7a0 0x7f61800c89c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 -- 172.21.15.42:0/3622238629 >> 172.21.15.42:0/3622238629 conn(0x7f6180069100 msgr2=0x7f61800d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 -- 172.21.15.42:0/3622238629 shutdown_connections 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.562+0000 7f6187cee640 1 -- 172.21.15.42:0/3622238629 wait complete. 2024-05-09T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.564+0000 7f6187cee640 1 Processor -- start 2024-05-09T01:41:00.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.564+0000 7f6187cee640 1 -- start start 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6187cee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 0x7f61801f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6187cee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61800ce7a0 0x7f6180160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6187cee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6180157220 0x7f618014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6187cee640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f618015d7f0 con 0x7f61800c8f00 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6187cee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f618015db00 con 0x7f61800ce7a0 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6187cee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f61800c7c60 con 0x7f6180157220 2024-05-09T01:41:00.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6185a8a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 0x7f61801f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6185a8a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 0x7f61801f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47070/0 (socket says 172.21.15.42:47070) 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6185a8a640 1 -- 172.21.15.42:0/346243132 learned_addr learned my addr 172.21.15.42:0/346243132 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.565+0000 7f6185289640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61800ce7a0 0x7f6180160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f618628b640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6180157220 0x7f618014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6185a8a640 1 -- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6180157220 msgr2=0x7f618014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6185a8a640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6180157220 0x7f618014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6185a8a640 1 -- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61800ce7a0 msgr2=0x7f6180160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6185a8a640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61800ce7a0 0x7f6180160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6185a8a640 1 -- 172.21.15.42:0/346243132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61801f3da0 con 0x7f61800c8f00 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f618628b640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6180157220 0x7f618014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6185a8a640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 0x7f61801f3860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f617000c7a0 tx=0x7f617000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170018070 con 0x7f61800c8f00 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617000a640 con 0x7f61800c8f00 2024-05-09T01:41:00.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61801595e0 con 0x7f61800c8f00 2024-05-09T01:41:00.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617000aa30 con 0x7f61800c8f00 2024-05-09T01:41:00.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.566+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6180159ba0 con 0x7f61800c8f00 2024-05-09T01:41:00.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.567+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618015a560 con 0x7f61800c8f00 2024-05-09T01:41:00.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.568+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f617001b070 con 0x7f61800c8f00 2024-05-09T01:41:00.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.568+0000 7f617e7fc640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f616c0762d0 0x7f616c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:00.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.569+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6170096f50 con 0x7f61800c8f00 2024-05-09T01:41:00.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.569+0000 7f6185289640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f616c0762d0 0x7f616c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:00.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.569+0000 7f6185289640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f616c0762d0 0x7f616c0787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6174034000 tx=0x7f617402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:00.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.572+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f61800c9310 con 0x7f61800c8f00 2024-05-09T01:41:00.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:00.808+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f618015a7c0 con 0x7f61800c8f00 2024-05-09T01:41:01.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:41:01.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:41:01.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.761+0000 7f617e7fc640 1 -- 172.21.15.42:0/346243132 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f61700601b0 con 0x7f61800c8f00 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f616c0762d0 msgr2=0x7f616c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f616c0762d0 0x7f616c0787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6174034000 tx=0x7f617402e000 comp rx=0 tx=0).stop 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 msgr2=0x7f61801f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 0x7f61801f3860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f617000c7a0 tx=0x7f617000cc60 comp rx=0 tx=0).stop 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 shutdown_connections 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f616c0762d0 0x7f616c0787e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6180157220 0x7f618014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61800ce7a0 0x7f6180160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 --2- 172.21.15.42:0/346243132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61800c8f00 0x7f61801f3860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 >> 172.21.15.42:0/346243132 conn(0x7f6180069100 msgr2=0x7f61801e81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:01.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 shutdown_connections 2024-05-09T01:41:01.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.765+0000 7f6187cee640 1 -- 172.21.15.42:0/346243132 wait complete. 2024-05-09T01:41:01.776 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-05-09T01:41:01.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-05-09T01:41:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.904+0000 7f164d934640 1 Processor -- start 2024-05-09T01:41:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.904+0000 7f164d934640 1 -- start start 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f164d934640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1648157080 0x7f1648160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f164d934640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16481608c0 0x7f1648160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f164d934640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1648157490 con 0x7f16480ce3f0 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f164d934640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f164806e530 con 0x7f1648157080 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f164d934640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f16480cccb0 con 0x7f16481608c0 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1648157080 0x7f1648160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1648157080 0x7f1648160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47086/0 (socket says 172.21.15.42:47086) 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 -- 172.21.15.42:0/53881579 learned_addr learned my addr 172.21.15.42:0/53881579 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16477fe640 1 --2- 172.21.15.42:0/53881579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16481608c0 0x7f1648160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 -- 172.21.15.42:0/53881579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16481608c0 msgr2=0x7f1648160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 --2- 172.21.15.42:0/53881579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16481608c0 0x7f1648160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 -- 172.21.15.42:0/53881579 >> v1:172.21.15.181:6789/0 conn(0x7f16480ce3f0 legacy=0x7f16480c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.906+0000 7f16467fc640 1 -- 172.21.15.42:0/53881579 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164806d640 con 0x7f1648157080 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.907+0000 7f16467fc640 1 --2- 172.21.15.42:0/53881579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648160380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1630009870 tx=0x7f163002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4794c677d291d510 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.907+0000 7f1645ffb640 1 -- 172.21.15.42:0/53881579 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630037070 con 0x7f1648157080 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.907+0000 7f1645ffb640 1 -- 172.21.15.42:0/53881579 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163002ae50 con 0x7f1648157080 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.907+0000 7f1645ffb640 1 -- 172.21.15.42:0/53881579 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630032860 con 0x7f1648157080 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 -- 172.21.15.42:0/53881579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 msgr2=0x7f1648160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 --2- 172.21.15.42:0/53881579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648160380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1630009870 tx=0x7f163002a300 comp rx=0 tx=0).stop 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 -- 172.21.15.42:0/53881579 shutdown_connections 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 --2- 172.21.15.42:0/53881579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16481608c0 0x7f1648160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 --2- 172.21.15.42:0/53881579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648160380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 -- 172.21.15.42:0/53881579 >> 172.21.15.42:0/53881579 conn(0x7f1648068fe0 msgr2=0x7f16480d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 -- 172.21.15.42:0/53881579 shutdown_connections 2024-05-09T01:41:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.908+0000 7f164d934640 1 -- 172.21.15.42:0/53881579 wait complete. 2024-05-09T01:41:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.910+0000 7f164d934640 1 Processor -- start 2024-05-09T01:41:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.910+0000 7f164d934640 1 -- start start 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f164d934640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16480ce3f0 0x7f16480b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f164d934640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f164d934640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16481608c0 0x7f164814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f164d934640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f164806dee0 con 0x7f1648157080 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f164d934640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f164806dc00 con 0x7f16481608c0 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f164d934640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f164806e1c0 con 0x7f16480ce3f0 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47090/0 (socket says 172.21.15.42:47090) 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 -- 172.21.15.42:0/2324963575 learned_addr learned my addr 172.21.15.42:0/2324963575 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f1646ffd640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16480ce3f0 0x7f16480b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16477fe640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16481608c0 0x7f164814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 -- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16480ce3f0 msgr2=0x7f16480b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16480ce3f0 0x7f16480b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 -- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16481608c0 msgr2=0x7f164814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.911+0000 7f16467fc640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16481608c0 0x7f164814ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f16467fc640 1 -- 172.21.15.42:0/2324963575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16481f3be0 con 0x7f1648157080 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f16477fe640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16481608c0 0x7f164814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f16467fc640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648155620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1630000c00 tx=0x7f16300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630041020 con 0x7f1648157080 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163003c670 con 0x7f1648157080 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1648150780 con 0x7f1648157080 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630037040 con 0x7f1648157080 2024-05-09T01:41:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.912+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1648150d40 con 0x7f1648157080 2024-05-09T01:41:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.913+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164806f0a0 con 0x7f1648157080 2024-05-09T01:41:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.914+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1630044020 con 0x7f1648157080 2024-05-09T01:41:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.914+0000 7f163ffff640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f16280762d0 0x7f16280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.914+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16300b7bc0 con 0x7f1648157080 2024-05-09T01:41:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.914+0000 7f1646ffd640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f16280762d0 0x7f16280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:01.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.915+0000 7f1646ffd640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f16280762d0 0x7f16280787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1638000f60 tx=0x7f1638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:01.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:01.919+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f164806f0a0 con 0x7f1648157080 2024-05-09T01:41:02.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.150+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f16481f3900 con 0x7f1648157080 2024-05-09T01:41:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.766+0000 7f163ffff640 1 -- 172.21.15.42:0/2324963575 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7f163004b030 con 0x7f1648157080 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f16280762d0 msgr2=0x7f16280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f16280762d0 0x7f16280787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1638000f60 tx=0x7f1638009040 comp rx=0 tx=0).stop 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 msgr2=0x7f1648155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648155620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1630000c00 tx=0x7f16300046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 shutdown_connections 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f16280762d0 0x7f16280787e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16481608c0 0x7f164814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1648157080 0x7f1648155620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 --2- 172.21.15.42:0/2324963575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16480ce3f0 0x7f16480b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 >> 172.21.15.42:0/2324963575 conn(0x7f1648068fe0 msgr2=0x7f16480c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:02.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 shutdown_connections 2024-05-09T01:41:02.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.768+0000 7f164d934640 1 -- 172.21.15.42:0/2324963575 wait complete. 2024-05-09T01:41:02.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T01:41:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.901+0000 7f69d1cd9640 1 Processor -- start 2024-05-09T01:41:02.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.901+0000 7f69d1cd9640 1 -- start start 2024-05-09T01:41:02.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.902+0000 7f69d1cd9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc06d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:02.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.902+0000 7f69d1cd9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f69cc0c90d0 0x7f69cc06da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:02.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.902+0000 7f69d1cd9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69cc0c7260 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.902+0000 7f69d1cd9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f69cc15dde0 con 0x7f69cc0c90d0 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.902+0000 7f69d1cd9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc0c7fe0 con 0x7f69cc157220 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f69cc0c90d0 0x7f69cc06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f69cc0c90d0 0x7f69cc06da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47104/0 (socket says 172.21.15.42:47104) 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 -- 172.21.15.42:0/3440094569 learned_addr learned my addr 172.21.15.42:0/3440094569 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69caffd640 1 --1- 172.21.15.42:0/3440094569 >> v1:172.21.15.42:6789/0 conn(0x7f69cc0ce7a0 0x7f69cc0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45744/0 (socket says 172.21.15.42:45744) 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cb7fe640 1 --2- 172.21.15.42:0/3440094569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc06d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 -- 172.21.15.42:0/3440094569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 msgr2=0x7f69cc06d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 --2- 172.21.15.42:0/3440094569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc06d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 -- 172.21.15.42:0/3440094569 >> v1:172.21.15.42:6789/0 conn(0x7f69cc0ce7a0 legacy=0x7f69cc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69cbfff640 1 -- 172.21.15.42:0/3440094569 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc0c7540 con 0x7f69cc0c90d0 2024-05-09T01:41:02.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.903+0000 7f69ca7fc640 1 -- 172.21.15.42:0/3440094569 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783462549 0 0) 0x7f69cc0c7260 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.904+0000 7f69cbfff640 1 --2- 172.21.15.42:0/3440094569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0c90d0 0x7f69cc06da40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009e50 tx=0x7f69c402a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f39361ead3c982d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.904+0000 7f69ca7fc640 1 -- 172.21.15.42:0/3440094569 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4036070 con 0x7f69cc0c90d0 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.904+0000 7f69ca7fc640 1 -- 172.21.15.42:0/3440094569 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c4031600 con 0x7f69cc0c90d0 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.904+0000 7f69ca7fc640 1 -- 172.21.15.42:0/3440094569 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c40319d0 con 0x7f69cc0c90d0 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 -- 172.21.15.42:0/3440094569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0c90d0 msgr2=0x7f69cc06da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/3440094569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0c90d0 0x7f69cc06da40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009e50 tx=0x7f69c402a670 comp rx=0 tx=0).stop 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 -- 172.21.15.42:0/3440094569 shutdown_connections 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/3440094569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0c90d0 0x7f69cc06da40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/3440094569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc06d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 -- 172.21.15.42:0/3440094569 >> 172.21.15.42:0/3440094569 conn(0x7f69cc069100 msgr2=0x7f69cc0d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 -- 172.21.15.42:0/3440094569 shutdown_connections 2024-05-09T01:41:02.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.905+0000 7f69d1cd9640 1 -- 172.21.15.42:0/3440094569 wait complete. 2024-05-09T01:41:02.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.906+0000 7f69d1cd9640 1 Processor -- start 2024-05-09T01:41:02.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.907+0000 7f69d1cd9640 1 -- start start 2024-05-09T01:41:02.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69d1cd9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 0x7f69cc0d1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69d1cd9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69d1cd9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69cc15e8d0 0x7f69cc15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69d1cd9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0c7c60 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69d1cd9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc15d7f0 con 0x7f69cc15e8d0 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69d1cd9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc0ce200 con 0x7f69cc157220 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 0x7f69cc0d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 0x7f69cc0d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47116/0 (socket says 172.21.15.42:47116) 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 -- 172.21.15.42:0/2085697094 learned_addr learned my addr 172.21.15.42:0/2085697094 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69caffd640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cbfff640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69cc15e8d0 0x7f69cc15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 -- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 msgr2=0x7f69cc1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc1f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 -- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69cc15e8d0 msgr2=0x7f69cc15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69cc15e8d0 0x7f69cc15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 -- 172.21.15.42:0/2085697094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc15c150 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69caffd640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69cb7fe640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 0x7f69cc0d1800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00d5f0 tx=0x7f69bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.908+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0125f0 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.909+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc019070 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.909+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc0d1d40 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.909+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0129d0 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.909+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc15c3e0 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.909+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc15a7c0 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.911+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69bc012b70 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.911+0000 7f69b3fff640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69b8076300 0x7f69b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.911+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69bc0985a0 con 0x7f69cc0ce7a0 2024-05-09T01:41:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.911+0000 7f69caffd640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69b8076300 0x7f69b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.912+0000 7f69caffd640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69b8076300 0x7f69b8078810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69c0000f60 tx=0x7f69c0007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:02.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:02.915+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f69bc061e70 con 0x7f69cc0ce7a0 2024-05-09T01:41:03.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.147+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f69cc0b7740 con 0x7f69cc0ce7a0 2024-05-09T01:41:03.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.767+0000 7f69b3fff640 1 -- 172.21.15.42:0/2085697094 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f69bc061770 con 0x7f69cc0ce7a0 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69b8076300 msgr2=0x7f69b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69b8076300 0x7f69b8078810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69c0000f60 tx=0x7f69c0007cc0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 msgr2=0x7f69cc0d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 0x7f69cc0d1800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00d5f0 tx=0x7f69bc00dab0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 shutdown_connections 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69b8076300 0x7f69b8078810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69cc15e8d0 0x7f69cc15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69cc157220 0x7f69cc1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 --2- 172.21.15.42:0/2085697094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc0ce7a0 0x7f69cc0d1800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 >> 172.21.15.42:0/2085697094 conn(0x7f69cc069100 msgr2=0x7f69cc0cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:03.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 shutdown_connections 2024-05-09T01:41:03.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.770+0000 7f69d1cd9640 1 -- 172.21.15.42:0/2085697094 wait complete. 2024-05-09T01:41:03.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-09T01:41:03.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.910+0000 7fe306213640 1 Processor -- start 2024-05-09T01:41:03.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.910+0000 7fe306213640 1 -- start start 2024-05-09T01:41:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe306213640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3000c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe306213640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3001602f0 0x7fe300160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe306213640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe300070ab0 con 0x7fe3000cb8b0 2024-05-09T01:41:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe306213640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe3000710c0 con 0x7fe3001602f0 2024-05-09T01:41:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe306213640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe3000c72e0 con 0x7fe300073200 2024-05-09T01:41:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe2fffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3001602f0 0x7fe300160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe2feffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe3000cb8b0 0x7fe300071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45754/0 (socket says 172.21.15.42:45754) 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.911+0000 7fe2feffd640 1 -- 172.21.15.42:0/1869695699 learned_addr learned my addr 172.21.15.42:0/1869695699 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.912+0000 7fe2ff7fe640 1 --2- 172.21.15.42:0/1869695699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3000c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.912+0000 7fe2fffff640 1 -- 172.21.15.42:0/1869695699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 msgr2=0x7fe3000c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.912+0000 7fe2fffff640 1 --2- 172.21.15.42:0/1869695699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3000c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.912+0000 7fe2fffff640 1 -- 172.21.15.42:0/1869695699 >> v1:172.21.15.42:6789/0 conn(0x7fe3000cb8b0 legacy=0x7fe300071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.912+0000 7fe2fffff640 1 -- 172.21.15.42:0/1869695699 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30006e080 con 0x7fe3001602f0 2024-05-09T01:41:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.912+0000 7fe2fe7fc640 1 -- 172.21.15.42:0/1869695699 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680069583 0 0) 0x7fe300070ab0 con 0x7fe3000cb8b0 2024-05-09T01:41:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe2fffff640 1 --2- 172.21.15.42:0/1869695699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3001602f0 0x7fe300160700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009dc0 tx=0x7fe2f802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368016664c7da855 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe2fe7fc640 1 -- 172.21.15.42:0/1869695699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f802ae60 con 0x7fe3001602f0 2024-05-09T01:41:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe2fe7fc640 1 -- 172.21.15.42:0/1869695699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f8007740 con 0x7fe3001602f0 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe2fe7fc640 1 -- 172.21.15.42:0/1869695699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8007b10 con 0x7fe3001602f0 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 -- 172.21.15.42:0/1869695699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3001602f0 msgr2=0x7fe300160700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 --2- 172.21.15.42:0/1869695699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3001602f0 0x7fe300160700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009dc0 tx=0x7fe2f802a680 comp rx=0 tx=0).stop 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 -- 172.21.15.42:0/1869695699 shutdown_connections 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 --2- 172.21.15.42:0/1869695699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3001602f0 0x7fe300160700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 --2- 172.21.15.42:0/1869695699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3000c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 -- 172.21.15.42:0/1869695699 >> 172.21.15.42:0/1869695699 conn(0x7fe300068c40 msgr2=0x7fe300072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 -- 172.21.15.42:0/1869695699 shutdown_connections 2024-05-09T01:41:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.913+0000 7fe306213640 1 -- 172.21.15.42:0/1869695699 wait complete. 2024-05-09T01:41:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.915+0000 7fe306213640 1 Processor -- start 2024-05-09T01:41:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.915+0000 7fe306213640 1 -- start start 2024-05-09T01:41:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3001514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 0x7fe3000b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3001602f0 0x7fe3000b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe300070d50 con 0x7fe3000cb8b0 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe30006e640 con 0x7fe3001602f0 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe3000cbef0 con 0x7fe300073200 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 0x7fe3000b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 0x7fe3000b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47136/0 (socket says 172.21.15.42:47136) 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 -- 172.21.15.42:0/1584637470 learned_addr learned my addr 172.21.15.42:0/1584637470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2fffff640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3001602f0 0x7fe3000b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2ff7fe640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3001514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 -- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 msgr2=0x7fe3001514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3001514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 -- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3001602f0 msgr2=0x7fe3000b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3001602f0 0x7fe3000b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 -- 172.21.15.42:0/1584637470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3000b35d0 con 0x7fe3000cb8b0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2feffd640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 0x7fe3000b3090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400c430 tx=0x7fe2f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4017070 con 0x7fe3000cb8b0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f4005ce0 con 0x7fe3000cb8b0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3001f6740 con 0x7fe3000cb8b0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4007310 con 0x7fe3000cb8b0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.917+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3001f6d00 con 0x7fe3000cb8b0 2024-05-09T01:41:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.918+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30006db40 con 0x7fe3000cb8b0 2024-05-09T01:41:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.919+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2f401a070 con 0x7fe3000cb8b0 2024-05-09T01:41:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.920+0000 7fe2e7fff640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe2ec076300 0x7fe2ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.920+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe2f40968d0 con 0x7fe3000cb8b0 2024-05-09T01:41:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.920+0000 7fe2ff7fe640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe2ec076300 0x7fe2ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.920+0000 7fe2ff7fe640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe2ec076300 0x7fe2ec078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006fd0 tx=0x7fe2f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:03.924+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe2f40602c0 con 0x7fe3000cb8b0 2024-05-09T01:41:04.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.155+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe3000768f0 con 0x7fe3000cb8b0 2024-05-09T01:41:04.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.777+0000 7fe2e7fff640 1 -- 172.21.15.42:0/1584637470 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) ==== 115+0+0 (secure 0 0 0) 0x7fe2f405fbc0 con 0x7fe3000cb8b0 2024-05-09T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.779+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe2ec076300 msgr2=0x7fe2ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.779+0000 7fe306213640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe2ec076300 0x7fe2ec078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006fd0 tx=0x7fe2f0008040 comp rx=0 tx=0).stop 2024-05-09T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.779+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 msgr2=0x7fe3000b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.779+0000 7fe306213640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 0x7fe3000b3090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400c430 tx=0x7fe2f400c8f0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 shutdown_connections 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe2ec076300 0x7fe2ec078810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3001602f0 0x7fe3000b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3000cb8b0 0x7fe3000b3090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 --2- 172.21.15.42:0/1584637470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe300073200 0x7fe3001514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 >> 172.21.15.42:0/1584637470 conn(0x7fe300068c40 msgr2=0x7fe30015e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 shutdown_connections 2024-05-09T01:41:04.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.780+0000 7fe306213640 1 -- 172.21.15.42:0/1584637470 wait complete. 2024-05-09T01:41:04.791 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T01:41:04.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:04.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.915+0000 7fa5af58d640 1 Processor -- start 2024-05-09T01:41:04.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.915+0000 7fa5af58d640 1 -- start start 2024-05-09T01:41:04.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5af58d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80cdaa0 0x7fa5a8157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:04.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5af58d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5a80ce4e0 0x7fa5a80ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5af58d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a80c7bf0 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5af58d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a80ce8f0 con 0x7fa5a80ce4e0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5af58d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a80c79a0 con 0x7fa5a80cdaa0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5adb2a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5a80ce4e0 0x7fa5a80ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5acb28640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa5a80ce0d0 0x7fa5a8160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45756/0 (socket says 172.21.15.42:45756) 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.916+0000 7fa5acb28640 1 -- 172.21.15.42:0/282815668 learned_addr learned my addr 172.21.15.42:0/282815668 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa5ad329640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80cdaa0 0x7fa5a8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa5adb2a640 1 -- 172.21.15.42:0/282815668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80cdaa0 msgr2=0x7fa5a8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa5adb2a640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80cdaa0 0x7fa5a8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa5adb2a640 1 -- 172.21.15.42:0/282815668 >> v1:172.21.15.42:6789/0 conn(0x7fa5a80ce0d0 legacy=0x7fa5a8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa5adb2a640 1 -- 172.21.15.42:0/282815668 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a80c7ed0 con 0x7fa5a80ce4e0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa59ffff640 1 -- 172.21.15.42:0/282815668 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132473991 0 0) 0x7fa5a80c7bf0 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.917+0000 7fa5ad329640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80cdaa0 0x7fa5a8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:04.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5adb2a640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce4e0 0x7fa5a80ceb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009d90 tx=0x7fa5a002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885a65622c04cbbc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa59ffff640 1 -- 172.21.15.42:0/282815668 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0007740 con 0x7fa5a80ce4e0 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa59ffff640 1 -- 172.21.15.42:0/282815668 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a00078e0 con 0x7fa5a80ce4e0 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa59ffff640 1 -- 172.21.15.42:0/282815668 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0007cb0 con 0x7fa5a80ce4e0 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 -- 172.21.15.42:0/282815668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce4e0 msgr2=0x7fa5a80ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce4e0 0x7fa5a80ceb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009d90 tx=0x7fa5a002a660 comp rx=0 tx=0).stop 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 -- 172.21.15.42:0/282815668 shutdown_connections 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce4e0 0x7fa5a80ceb00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 --2- 172.21.15.42:0/282815668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80cdaa0 0x7fa5a8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 -- 172.21.15.42:0/282815668 >> 172.21.15.42:0/282815668 conn(0x7fa5a8068610 msgr2=0x7fa5a8068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.918+0000 7fa5af58d640 1 -- 172.21.15.42:0/282815668 shutdown_connections 2024-05-09T01:41:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.919+0000 7fa5af58d640 1 -- 172.21.15.42:0/282815668 wait complete. 2024-05-09T01:41:04.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.920+0000 7fa5af58d640 1 Processor -- start 2024-05-09T01:41:04.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.920+0000 7fa5af58d640 1 -- start start 2024-05-09T01:41:04.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.921+0000 7fa5af58d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5a80cdaa0 0x7fa5a80cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:04.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5af58d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 0x7fa5a814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:04.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5af58d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80ce4e0 0x7fa5a80d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:04.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5af58d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80c8770 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5af58d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80c8490 con 0x7fa5a80cdaa0 2024-05-09T01:41:04.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5af58d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a8160470 con 0x7fa5a80ce4e0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 0x7fa5a814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 0x7fa5a814e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47154/0 (socket says 172.21.15.42:47154) 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 -- 172.21.15.42:0/2974029341 learned_addr learned my addr 172.21.15.42:0/2974029341 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5ad329640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5a80cdaa0 0x7fa5a80cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5adb2a640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80ce4e0 0x7fa5a80d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 -- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80ce4e0 msgr2=0x7fa5a80d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80ce4e0 0x7fa5a80d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 -- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5a80cdaa0 msgr2=0x7fa5a80cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5a80cdaa0 0x7fa5a80cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 -- 172.21.15.42:0/2974029341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a814ea10 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5ad329640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5a80cdaa0 0x7fa5a80cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5acb28640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 0x7fa5a814e4d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa59800c3f0 tx=0x7fa59800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5980074e0 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5980047e0 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a80b4b30 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.922+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598004bd0 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.923+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a81e58b0 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.923+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a80b4e00 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.924+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa598011070 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.925+0000 7fa59dffb640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa58c0762d0 0x7fa58c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:04.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.925+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa598097260 con 0x7fa5a80ce0d0 2024-05-09T01:41:04.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.925+0000 7fa5ad329640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa58c0762d0 0x7fa58c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:04.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.926+0000 7fa5ad329640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa58c0762d0 0x7fa58c0787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400a990 tx=0x7fa5a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:04.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:04.930+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa598060a90 con 0x7fa5a80ce0d0 2024-05-09T01:41:05.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.160+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5a80c74e0 con 0x7fa5a80ce0d0 2024-05-09T01:41:05.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.160+0000 7fa59dffb640 1 -- 172.21.15.42:0/2974029341 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6846 (secure 0 0 0) 0x7fa598060390 con 0x7fa5a80ce0d0 2024-05-09T01:41:05.158 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:05.158 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:04.780742+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4311,"mds_1":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311]},"id":1}]} 2024-05-09T01:41:05.158 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 9 2024-05-09T01:41:05.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa58c0762d0 msgr2=0x7fa58c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa58c0762d0 0x7fa58c0787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400a990 tx=0x7fa5a4008040 comp rx=0 tx=0).stop 2024-05-09T01:41:05.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 msgr2=0x7fa5a814e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 0x7fa5a814e4d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa59800c3f0 tx=0x7fa59800c8b0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 shutdown_connections 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa58c0762d0 0x7fa58c0787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.162+0000 7fa5af58d640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5a80ce4e0 0x7fa5a80d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.163+0000 7fa5af58d640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5a80ce0d0 0x7fa5a814e4d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.163+0000 7fa5af58d640 1 --2- 172.21.15.42:0/2974029341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5a80cdaa0 0x7fa5a80cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.163+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 >> 172.21.15.42:0/2974029341 conn(0x7fa5a8068610 msgr2=0x7fa5a806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.163+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 shutdown_connections 2024-05-09T01:41:05.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.163+0000 7fa5af58d640 1 -- 172.21.15.42:0/2974029341 wait complete. 2024-05-09T01:41:05.171 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:41:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.288+0000 7f92962e9640 1 Processor -- start 2024-05-09T01:41:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.288+0000 7f92962e9640 1 -- start start 2024-05-09T01:41:05.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f92962e9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f92900cdaa0 0x7f9290157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f92962e9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900ce0d0 0x7f92900ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f92962e9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92900c7bf0 con 0x7f9290160990 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f92962e9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f92900c79a0 con 0x7f92900cdaa0 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f92962e9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92900c7ed0 con 0x7f92900ce0d0 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f928ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f92900cdaa0 0x7f9290157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f9294886640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9290160990 0x7f92900ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45764/0 (socket says 172.21.15.42:45764) 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f9294886640 1 -- 172.21.15.42:0/2322387180 learned_addr learned my addr 172.21.15.42:0/2322387180 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f928ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f92900cdaa0 0x7f9290157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47160/0 (socket says 172.21.15.42:47160) 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f9287fff640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900ce0d0 0x7f92900ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f928ffff640 1 -- 172.21.15.42:0/2322387180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900ce0d0 msgr2=0x7f92900ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f928ffff640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900ce0d0 0x7f92900ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f928ffff640 1 -- 172.21.15.42:0/2322387180 >> v1:172.21.15.42:6789/0 conn(0x7f9290160990 legacy=0x7f92900ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f928ffff640 1 -- 172.21.15.42:0/2322387180 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92900c81b0 con 0x7f92900cdaa0 2024-05-09T01:41:05.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.290+0000 7f9287fff640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900ce0d0 0x7f92900ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.291+0000 7f928ffff640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900cdaa0 0x7f9290157100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92900c7b20 tx=0x7f928002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8d637d18ca7a65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.291+0000 7f928f7fe640 1 -- 172.21.15.42:0/2322387180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280037070 con 0x7f92900cdaa0 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.291+0000 7f928f7fe640 1 -- 172.21.15.42:0/2322387180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280032440 con 0x7f92900cdaa0 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.291+0000 7f928f7fe640 1 -- 172.21.15.42:0/2322387180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280032810 con 0x7f92900cdaa0 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 -- 172.21.15.42:0/2322387180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900cdaa0 msgr2=0x7f9290157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900cdaa0 0x7f9290157100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92900c7b20 tx=0x7f928002a180 comp rx=0 tx=0).stop 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 -- 172.21.15.42:0/2322387180 shutdown_connections 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900ce0d0 0x7f92900ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 --2- 172.21.15.42:0/2322387180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900cdaa0 0x7f9290157100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 -- 172.21.15.42:0/2322387180 >> 172.21.15.42:0/2322387180 conn(0x7f9290068610 msgr2=0x7f9290068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 -- 172.21.15.42:0/2322387180 shutdown_connections 2024-05-09T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.292+0000 7f92962e9640 1 -- 172.21.15.42:0/2322387180 wait complete. 2024-05-09T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.293+0000 7f92962e9640 1 Processor -- start 2024-05-09T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.294+0000 7f92962e9640 1 -- start start 2024-05-09T01:41:05.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f92962e9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900cdaa0 0x7f92901f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f92962e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 0x7f92900caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f92962e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9290160990 0x7f929014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f92962e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9290160470 con 0x7f92900ce0d0 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f92962e9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92900c8770 con 0x7f9290160990 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f92962e9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92900cf210 con 0x7f92900cdaa0 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 0x7f92900caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 0x7f92900caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47174/0 (socket says 172.21.15.42:47174) 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 -- 172.21.15.42:0/2445336761 learned_addr learned my addr 172.21.15.42:0/2445336761 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f928ffff640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900cdaa0 0x7f92901f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9294886640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9290160990 0x7f929014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 -- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900cdaa0 msgr2=0x7f92901f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900cdaa0 0x7f92901f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 -- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9290160990 msgr2=0x7f929014b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9290160990 0x7f929014b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 -- 172.21.15.42:0/2445336761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92900cb570 con 0x7f92900ce0d0 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.295+0000 7f9287fff640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 0x7f92900caab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f927800d800 tx=0x7f927800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.296+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278004030 con 0x7f92900ce0d0 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.296+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92780041d0 con 0x7f92900ce0d0 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.296+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278009640 con 0x7f92900ce0d0 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.296+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92900cb850 con 0x7f92900ce0d0 2024-05-09T01:41:05.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.296+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92901f3800 con 0x7f92900ce0d0 2024-05-09T01:41:05.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.296+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92900c74e0 con 0x7f92900ce0d0 2024-05-09T01:41:05.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.297+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92780097e0 con 0x7f92900ce0d0 2024-05-09T01:41:05.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.298+0000 7f928d7fa640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f92700762d0 0x7f92700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.298+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9278097740 con 0x7f92900ce0d0 2024-05-09T01:41:05.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.298+0000 7f928ffff640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f92700762d0 0x7f92700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.299+0000 7f928ffff640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f92700762d0 0x7f92700787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9280034000 tx=0x7f928002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:05.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.303+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9278060a50 con 0x7f92900ce0d0 2024-05-09T01:41:05.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.494+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92900cd880 con 0x7f92900ce0d0 2024-05-09T01:41:05.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.495+0000 7f928d7fa640 1 -- 172.21.15.42:0/2445336761 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f9278064d50 con 0x7f92900ce0d0 2024-05-09T01:41:05.493 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:05.493 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:00.734921+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f92700762d0 msgr2=0x7f92700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f92700762d0 0x7f92700787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9280034000 tx=0x7f928002e000 comp rx=0 tx=0).stop 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 msgr2=0x7f92900caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 0x7f92900caab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f927800d800 tx=0x7f927800dcc0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 shutdown_connections 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f92700762d0 0x7f92700787e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9290160990 0x7f929014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92900ce0d0 0x7f92900caab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 --2- 172.21.15.42:0/2445336761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92900cdaa0 0x7f92901f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 >> 172.21.15.42:0/2445336761 conn(0x7f9290068610 msgr2=0x7f929006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.497+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 shutdown_connections 2024-05-09T01:41:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.498+0000 7f92962e9640 1 -- 172.21.15.42:0/2445336761 wait complete. 2024-05-09T01:41:05.506 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T01:41:05.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:05.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.623+0000 7f819111f640 1 Processor -- start 2024-05-09T01:41:05.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.623+0000 7f819111f640 1 -- start start 2024-05-09T01:41:05.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f819111f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 0x7f818c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f819111f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f818c154f30 0x7f818c15e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f819111f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818c0caa10 con 0x7f818c071be0 2024-05-09T01:41:05.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f819111f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f818c071750 con 0x7f818c154f30 2024-05-09T01:41:05.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f819111f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f818c0cb200 con 0x7f818c154b20 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818a59c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 0x7f818c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818b59e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f818c154f30 0x7f818c15e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818ad9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f818c071be0 0x7f818c0c5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:57992/0 (socket says 172.21.15.42:57992) 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818ad9d640 1 -- 172.21.15.42:0/3232499560 learned_addr learned my addr 172.21.15.42:0/3232499560 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818a59c640 1 --2- 172.21.15.42:0/3232499560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 0x7f818c15e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:47046/0 (socket says 172.21.15.42:47046) 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818b59e640 1 --2- 172.21.15.42:0/3232499560 >> v2:172.21.15.181:3300/0 conn(0x7f818c154f30 0x7f818c15e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42268/0 (socket says 172.21.15.42:42268) 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818a59c640 1 -- 172.21.15.42:0/3232499560 >> v2:172.21.15.181:3300/0 conn(0x7f818c154f30 msgr2=0x7f818c15e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818a59c640 1 --2- 172.21.15.42:0/3232499560 >> v2:172.21.15.181:3300/0 conn(0x7f818c154f30 0x7f818c15e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818a59c640 1 -- 172.21.15.42:0/3232499560 >> v1:172.21.15.181:6789/0 conn(0x7f818c071be0 legacy=0x7f818c0c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.625+0000 7f818a59c640 1 -- 172.21.15.42:0/3232499560 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c0cb740 con 0x7f818c154b20 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.626+0000 7f818a59c640 1 --2- 172.21.15.42:0/3232499560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 0x7f818c15e0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81740097a0 tx=0x7f817402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d0b45028996206 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.626+0000 7f8189d9b640 1 -- 172.21.15.42:0/3232499560 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174037070 con 0x7f818c154b20 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.626+0000 7f8189d9b640 1 -- 172.21.15.42:0/3232499560 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8174032440 con 0x7f818c154b20 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.626+0000 7f8189d9b640 1 -- 172.21.15.42:0/3232499560 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174032810 con 0x7f818c154b20 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 -- 172.21.15.42:0/3232499560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 msgr2=0x7f818c15e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 --2- 172.21.15.42:0/3232499560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 0x7f818c15e0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81740097a0 tx=0x7f817402a180 comp rx=0 tx=0).stop 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 -- 172.21.15.42:0/3232499560 shutdown_connections 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 --2- 172.21.15.42:0/3232499560 >> v2:172.21.15.181:3300/0 conn(0x7f818c154f30 0x7f818c15e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 --2- 172.21.15.42:0/3232499560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c154b20 0x7f818c15e0a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 -- 172.21.15.42:0/3232499560 >> 172.21.15.42:0/3232499560 conn(0x7f818c0d0660 msgr2=0x7f818c072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:05.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 -- 172.21.15.42:0/3232499560 shutdown_connections 2024-05-09T01:41:05.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.627+0000 7f819111f640 1 -- 172.21.15.42:0/3232499560 wait complete. 2024-05-09T01:41:05.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.629+0000 7f819111f640 1 Processor -- start 2024-05-09T01:41:05.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.629+0000 7f819111f640 1 -- start start 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.630+0000 7f819111f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 0x7f818c1f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.630+0000 7f819111f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c154b20 0x7f818c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f819111f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c147ec0 0x7f818c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f819111f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0713e0 con 0x7f818c071be0 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f819111f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f818c071100 con 0x7f818c154b20 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f819111f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f818c0cb970 con 0x7f818c147ec0 2024-05-09T01:41:05.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 0x7f818c1f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 0x7f818c1f67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47180/0 (socket says 172.21.15.42:47180) 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 -- 172.21.15.42:0/515108072 learned_addr learned my addr 172.21.15.42:0/515108072 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818a59c640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c154b20 0x7f818c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818b59e640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c147ec0 0x7f818c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 -- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c147ec0 msgr2=0x7f818c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c147ec0 0x7f818c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 -- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c154b20 msgr2=0x7f818c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c154b20 0x7f818c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 -- 172.21.15.42:0/515108072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c15d4d0 con 0x7f818c071be0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f818ad9d640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 0x7f818c1f67d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c400 tx=0x7f817c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c017070 con 0x7f818c071be0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c005d00 con 0x7f818c071be0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818c1f2a40 con 0x7f818c071be0 2024-05-09T01:41:05.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c007310 con 0x7f818c071be0 2024-05-09T01:41:05.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.631+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818c150400 con 0x7f818c071be0 2024-05-09T01:41:05.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.632+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818c0cbcc0 con 0x7f818c071be0 2024-05-09T01:41:05.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.633+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f817c01a070 con 0x7f818c071be0 2024-05-09T01:41:05.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.634+0000 7f81837fe640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f816c0762d0 0x7f816c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:05.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.634+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f817c0968e0 con 0x7f818c071be0 2024-05-09T01:41:05.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.634+0000 7f818a59c640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f816c0762d0 0x7f816c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:05.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.634+0000 7f818a59c640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f816c0762d0 0x7f816c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8174034000 tx=0x7f817402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:05.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.638+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f817c05fb50 con 0x7f818c071be0 2024-05-09T01:41:05.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.825+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f818c15d7b0 con 0x7f816c0762d0 2024-05-09T01:41:05.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.832+0000 7f81837fe640 1 -- 172.21.15.42:0/515108072 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251819 (secure 0 0 0) 0x7f8174032770 con 0x7f816c0762d0 2024-05-09T01:41:05.832 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:05.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f816c0762d0 msgr2=0x7f816c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f816c0762d0 0x7f816c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8174034000 tx=0x7f817402e000 comp rx=0 tx=0).stop 2024-05-09T01:41:05.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 msgr2=0x7f818c1f67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 0x7f818c1f67d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c400 tx=0x7f817c00c8c0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 shutdown_connections 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f816c0762d0 0x7f816c0787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818c147ec0 0x7f818c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c154b20 0x7f818c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 --2- 172.21.15.42:0/515108072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f818c071be0 0x7f818c1f67d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 >> 172.21.15.42:0/515108072 conn(0x7f818c0d0660 msgr2=0x7f818c151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 shutdown_connections 2024-05-09T01:41:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:05.835+0000 7f819111f640 1 -- 172.21.15.42:0/515108072 wait complete. 2024-05-09T01:41:05.843 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-09T01:41:04.214386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239724,"kb_used_data":2732,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734996,"statfs":{"total":773094113280,"available":772848635904,"internally_reserved":0,"allocated":2797568,"data_stored":1736876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001762"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763307+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:40:59.763307+0000","last_peered":"2024-05-09T01:40:59.763307+0000","last_clean":"2024-05-09T01:40:59.763307+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:40:59.763307+0000","last_undegraded":"2024-05-09T01:40:59.763307+0000","last_fullsized":"2024-05-09T01:40:59.763307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:55.998346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.760843+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:40:59.760843+0000","last_peered":"2024-05-09T01:40:59.760843+0000","last_clean":"2024-05-09T01:40:59.760843+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:40:59.760843+0000","last_undegraded":"2024-05-09T01:40:59.760843+0000","last_fullsized":"2024-05-09T01:40:59.760843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:35.050021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763048+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:40:59.763048+0000","last_peered":"2024-05-09T01:40:59.763048+0000","last_clean":"2024-05-09T01:40:59.763048+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:40:59.763048+0000","last_undegraded":"2024-05-09T01:40:59.763048+0000","last_fullsized":"2024-05-09T01:40:59.763048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:48.990615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.756269+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:40:59.756269+0000","last_peered":"2024-05-09T01:40:59.756269+0000","last_clean":"2024-05-09T01:40:59.756269+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:40:59.756269+0000","last_undegraded":"2024-05-09T01:40:59.756269+0000","last_fullsized":"2024-05-09T01:40:59.756269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:50.779855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763203+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:40:59.763203+0000","last_peered":"2024-05-09T01:40:59.763203+0000","last_clean":"2024-05-09T01:40:59.763203+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:40:59.763203+0000","last_undegraded":"2024-05-09T01:40:59.763203+0000","last_fullsized":"2024-05-09T01:40:59.763203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:11.155139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763274+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:40:59.763274+0000","last_peered":"2024-05-09T01:40:59.763274+0000","last_clean":"2024-05-09T01:40:59.763274+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:40:59.763274+0000","last_undegraded":"2024-05-09T01:40:59.763274+0000","last_fullsized":"2024-05-09T01:40:59.763274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:04.608902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.761862+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:40:59.761862+0000","last_peered":"2024-05-09T01:40:59.761862+0000","last_clean":"2024-05-09T01:40:59.761862+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:40:59.761862+0000","last_undegraded":"2024-05-09T01:40:59.761862+0000","last_fullsized":"2024-05-09T01:40:59.761862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:37.902244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.759877+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:40:59.759877+0000","last_peered":"2024-05-09T01:40:59.759877+0000","last_clean":"2024-05-09T01:40:59.759877+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:40:59.759877+0000","last_undegraded":"2024-05-09T01:40:59.759877+0000","last_fullsized":"2024-05-09T01:40:59.759877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:50.512826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738559+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:00.738559+0000","last_peered":"2024-05-09T01:41:00.738559+0000","last_clean":"2024-05-09T01:41:00.738559+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:00.738559+0000","last_undegraded":"2024-05-09T01:41:00.738559+0000","last_fullsized":"2024-05-09T01:41:00.738559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763135+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:40:59.763135+0000","last_peered":"2024-05-09T01:40:59.763135+0000","last_clean":"2024-05-09T01:40:59.763135+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:40:59.763135+0000","last_undegraded":"2024-05-09T01:40:59.763135+0000","last_fullsized":"2024-05-09T01:40:59.763135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:16.192794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337139+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:01.337139+0000","last_peered":"2024-05-09T01:41:01.337139+0000","last_clean":"2024-05-09T01:41:01.337139+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:01.337139+0000","last_undegraded":"2024-05-09T01:41:01.337139+0000","last_fullsized":"2024-05-09T01:41:01.337139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738548+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:00.738548+0000","last_peered":"2024-05-09T01:41:00.738548+0000","last_clean":"2024-05-09T01:41:00.738548+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:00.738548+0000","last_undegraded":"2024-05-09T01:41:00.738548+0000","last_fullsized":"2024-05-09T01:41:00.738548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396872+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:01.396872+0000","last_peered":"2024-05-09T01:41:01.396872+0000","last_clean":"2024-05-09T01:41:01.396872+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:01.396872+0000","last_undegraded":"2024-05-09T01:41:01.396872+0000","last_fullsized":"2024-05-09T01:41:01.396872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337492+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:01.337492+0000","last_peered":"2024-05-09T01:41:01.337492+0000","last_clean":"2024-05-09T01:41:01.337492+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:01.337492+0000","last_undegraded":"2024-05-09T01:41:01.337492+0000","last_fullsized":"2024-05-09T01:41:01.337492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397065+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:01.397065+0000","last_peered":"2024-05-09T01:41:01.397065+0000","last_clean":"2024-05-09T01:41:01.397065+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:01.397065+0000","last_undegraded":"2024-05-09T01:41:01.397065+0000","last_fullsized":"2024-05-09T01:41:01.397065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763946+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:40:59.763946+0000","last_peered":"2024-05-09T01:40:59.763946+0000","last_clean":"2024-05-09T01:40:59.763946+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:40:59.763946+0000","last_undegraded":"2024-05-09T01:40:59.763946+0000","last_fullsized":"2024-05-09T01:40:59.763946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:44.069056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.765422+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:40:59.765422+0000","last_peered":"2024-05-09T01:40:59.765422+0000","last_clean":"2024-05-09T01:40:59.765422+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:40:59.765422+0000","last_undegraded":"2024-05-09T01:40:59.765422+0000","last_fullsized":"2024-05-09T01:40:59.765422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:14.741205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337329+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:01.337329+0000","last_peered":"2024-05-09T01:41:01.337329+0000","last_clean":"2024-05-09T01:41:01.337329+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:01.337329+0000","last_undegraded":"2024-05-09T01:41:01.337329+0000","last_fullsized":"2024-05-09T01:41:01.337329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.744549+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:40:59.744549+0000","last_peered":"2024-05-09T01:40:59.744549+0000","last_clean":"2024-05-09T01:40:59.744549+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:40:59.744549+0000","last_undegraded":"2024-05-09T01:40:59.744549+0000","last_fullsized":"2024-05-09T01:40:59.744549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763205+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:40:59.763205+0000","last_peered":"2024-05-09T01:40:59.763205+0000","last_clean":"2024-05-09T01:40:59.763205+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:40:59.763205+0000","last_undegraded":"2024-05-09T01:40:59.763205+0000","last_fullsized":"2024-05-09T01:40:59.763205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:12:17.883144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397392+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:01.397392+0000","last_peered":"2024-05-09T01:41:01.397392+0000","last_clean":"2024-05-09T01:41:01.397392+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:01.397392+0000","last_undegraded":"2024-05-09T01:41:01.397392+0000","last_fullsized":"2024-05-09T01:41:01.397392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337112+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:01.337112+0000","last_peered":"2024-05-09T01:41:01.337112+0000","last_clean":"2024-05-09T01:41:01.337112+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:01.337112+0000","last_undegraded":"2024-05-09T01:41:01.337112+0000","last_fullsized":"2024-05-09T01:41:01.337112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.742646+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:40:59.742646+0000","last_peered":"2024-05-09T01:40:59.742646+0000","last_clean":"2024-05-09T01:40:59.742646+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:40:59.742646+0000","last_undegraded":"2024-05-09T01:40:59.742646+0000","last_fullsized":"2024-05-09T01:40:59.742646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.745080+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:40:59.745080+0000","last_peered":"2024-05-09T01:40:59.745080+0000","last_clean":"2024-05-09T01:40:59.745080+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:40:59.745080+0000","last_undegraded":"2024-05-09T01:40:59.745080+0000","last_fullsized":"2024-05-09T01:40:59.745080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.743410+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:40:59.743410+0000","last_peered":"2024-05-09T01:40:59.743410+0000","last_clean":"2024-05-09T01:40:59.743410+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:40:59.743410+0000","last_undegraded":"2024-05-09T01:40:59.743410+0000","last_fullsized":"2024-05-09T01:40:59.743410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895608+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:00.895608+0000","last_peered":"2024-05-09T01:41:00.895608+0000","last_clean":"2024-05-09T01:41:00.895608+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:00.895608+0000","last_undegraded":"2024-05-09T01:41:00.895608+0000","last_fullsized":"2024-05-09T01:41:00.895608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.744240+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:40:59.744240+0000","last_peered":"2024-05-09T01:40:59.744240+0000","last_clean":"2024-05-09T01:40:59.744240+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:40:59.744240+0000","last_undegraded":"2024-05-09T01:40:59.744240+0000","last_fullsized":"2024-05-09T01:40:59.744240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397003+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:01.397003+0000","last_peered":"2024-05-09T01:41:01.397003+0000","last_clean":"2024-05-09T01:41:01.397003+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:01.397003+0000","last_undegraded":"2024-05-09T01:41:01.397003+0000","last_fullsized":"2024-05-09T01:41:01.397003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742686+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:00.742686+0000","last_peered":"2024-05-09T01:41:00.742686+0000","last_clean":"2024-05-09T01:41:00.742686+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:00.742686+0000","last_undegraded":"2024-05-09T01:41:00.742686+0000","last_fullsized":"2024-05-09T01:41:00.742686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.762969+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:40:59.762969+0000","last_peered":"2024-05-09T01:40:59.762969+0000","last_clean":"2024-05-09T01:40:59.762969+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:40:59.762969+0000","last_undegraded":"2024-05-09T01:40:59.762969+0000","last_fullsized":"2024-05-09T01:40:59.762969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:49.825059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.744849+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:40:59.744849+0000","last_peered":"2024-05-09T01:40:59.744849+0000","last_clean":"2024-05-09T01:40:59.744849+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:40:59.744849+0000","last_undegraded":"2024-05-09T01:40:59.744849+0000","last_fullsized":"2024-05-09T01:40:59.744849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397483+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:01.397483+0000","last_peered":"2024-05-09T01:41:01.397483+0000","last_clean":"2024-05-09T01:41:01.397483+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:01.397483+0000","last_undegraded":"2024-05-09T01:41:01.397483+0000","last_fullsized":"2024-05-09T01:41:01.397483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.765336+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:40:59.765336+0000","last_peered":"2024-05-09T01:40:59.765336+0000","last_clean":"2024-05-09T01:40:59.765336+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:40:59.765336+0000","last_undegraded":"2024-05-09T01:40:59.765336+0000","last_fullsized":"2024-05-09T01:40:59.765336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:25.981579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895471+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:00.895471+0000","last_peered":"2024-05-09T01:41:00.895471+0000","last_clean":"2024-05-09T01:41:00.895471+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:00.895471+0000","last_undegraded":"2024-05-09T01:41:00.895471+0000","last_fullsized":"2024-05-09T01:41:00.895471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743341+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:00.743341+0000","last_peered":"2024-05-09T01:41:00.743341+0000","last_clean":"2024-05-09T01:41:00.743341+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:00.743341+0000","last_undegraded":"2024-05-09T01:41:00.743341+0000","last_fullsized":"2024-05-09T01:41:00.743341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895677+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:00.895677+0000","last_peered":"2024-05-09T01:41:00.895677+0000","last_clean":"2024-05-09T01:41:00.895677+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:00.895677+0000","last_undegraded":"2024-05-09T01:41:00.895677+0000","last_fullsized":"2024-05-09T01:41:00.895677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337554+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:01.337554+0000","last_peered":"2024-05-09T01:41:01.337554+0000","last_clean":"2024-05-09T01:41:01.337554+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:01.337554+0000","last_undegraded":"2024-05-09T01:41:01.337554+0000","last_fullsized":"2024-05-09T01:41:01.337554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763099+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:40:59.763099+0000","last_peered":"2024-05-09T01:40:59.763099+0000","last_clean":"2024-05-09T01:40:59.763099+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:40:59.763099+0000","last_undegraded":"2024-05-09T01:40:59.763099+0000","last_fullsized":"2024-05-09T01:40:59.763099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:59.150456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742602+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:00.742602+0000","last_peered":"2024-05-09T01:41:00.742602+0000","last_clean":"2024-05-09T01:41:00.742602+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:00.742602+0000","last_undegraded":"2024-05-09T01:41:00.742602+0000","last_fullsized":"2024-05-09T01:41:00.742602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.756281+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:40:59.756281+0000","last_peered":"2024-05-09T01:40:59.756281+0000","last_clean":"2024-05-09T01:40:59.756281+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:40:59.756281+0000","last_undegraded":"2024-05-09T01:40:59.756281+0000","last_fullsized":"2024-05-09T01:40:59.756281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:14.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895494+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:00.895494+0000","last_peered":"2024-05-09T01:41:00.895494+0000","last_clean":"2024-05-09T01:41:00.895494+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:00.895494+0000","last_undegraded":"2024-05-09T01:41:00.895494+0000","last_fullsized":"2024-05-09T01:41:00.895494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895478+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:00.895478+0000","last_peered":"2024-05-09T01:41:00.895478+0000","last_clean":"2024-05-09T01:41:00.895478+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:00.895478+0000","last_undegraded":"2024-05-09T01:41:00.895478+0000","last_fullsized":"2024-05-09T01:41:00.895478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743040+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:00.743040+0000","last_peered":"2024-05-09T01:41:00.743040+0000","last_clean":"2024-05-09T01:41:00.743040+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:00.743040+0000","last_undegraded":"2024-05-09T01:41:00.743040+0000","last_fullsized":"2024-05-09T01:41:00.743040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742932+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:00.742932+0000","last_peered":"2024-05-09T01:41:00.742932+0000","last_clean":"2024-05-09T01:41:00.742932+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:00.742932+0000","last_undegraded":"2024-05-09T01:41:00.742932+0000","last_fullsized":"2024-05-09T01:41:00.742932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743198+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:00.743198+0000","last_peered":"2024-05-09T01:41:00.743198+0000","last_clean":"2024-05-09T01:41:00.743198+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:00.743198+0000","last_undegraded":"2024-05-09T01:41:00.743198+0000","last_fullsized":"2024-05-09T01:41:00.743198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763973+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:40:59.763973+0000","last_peered":"2024-05-09T01:40:59.763973+0000","last_clean":"2024-05-09T01:40:59.763973+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:40:59.763973+0000","last_undegraded":"2024-05-09T01:40:59.763973+0000","last_fullsized":"2024-05-09T01:40:59.763973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:44.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738369+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:00.738369+0000","last_peered":"2024-05-09T01:41:00.738369+0000","last_clean":"2024-05-09T01:41:00.738369+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:00.738369+0000","last_undegraded":"2024-05-09T01:41:00.738369+0000","last_fullsized":"2024-05-09T01:41:00.738369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.743458+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:40:59.743458+0000","last_peered":"2024-05-09T01:40:59.743458+0000","last_clean":"2024-05-09T01:40:59.743458+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:40:59.743458+0000","last_undegraded":"2024-05-09T01:40:59.743458+0000","last_fullsized":"2024-05-09T01:40:59.743458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":663823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":657523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:05.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:05.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.002+0000 7f24782c8640 1 Processor -- start 2024-05-09T01:41:05.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.002+0000 7f24782c8640 1 -- start start 2024-05-09T01:41:06.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f24782c8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24700c7020 0x7f2470156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f24782c8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f247006e990 0x7f247006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f24782c8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f247006daf0 0x7f24700cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f24782c8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f24700ccb00 con 0x7f24700c7020 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f24782c8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f24700ccde0 con 0x7f247006e990 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f24782c8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f24700ce880 con 0x7f247006daf0 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f2476064640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24700c7020 0x7f2470156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f2476064640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24700c7020 0x7f2470156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47190/0 (socket says 172.21.15.42:47190) 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f2476064640 1 -- 172.21.15.42:0/1133662994 learned_addr learned my addr 172.21.15.42:0/1133662994 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.003+0000 7f2476865640 1 --2- 172.21.15.42:0/1133662994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f247006daf0 0x7f24700cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2475863640 1 --2- 172.21.15.42:0/1133662994 >> v2:172.21.15.181:3300/0 conn(0x7f247006e990 0x7f247006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2476064640 1 -- 172.21.15.42:0/1133662994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f247006daf0 msgr2=0x7f24700cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2476064640 1 --2- 172.21.15.42:0/1133662994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f247006daf0 0x7f24700cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2476064640 1 -- 172.21.15.42:0/1133662994 >> v2:172.21.15.181:3300/0 conn(0x7f247006e990 msgr2=0x7f247006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2476064640 1 --2- 172.21.15.42:0/1133662994 >> v2:172.21.15.181:3300/0 conn(0x7f247006e990 0x7f247006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2476064640 1 -- 172.21.15.42:0/1133662994 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247015d7f0 con 0x7f24700c7020 2024-05-09T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2475863640 1 --2- 172.21.15.42:0/1133662994 >> v2:172.21.15.181:3300/0 conn(0x7f247006e990 0x7f247006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.004+0000 7f2476064640 1 --2- 172.21.15.42:0/1133662994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24700c7020 0x7f2470156d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f247015d9c0 tx=0x7f246c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba02f89f4a4cda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f2475062640 1 -- 172.21.15.42:0/1133662994 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c036070 con 0x7f24700c7020 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f2475062640 1 -- 172.21.15.42:0/1133662994 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c031600 con 0x7f24700c7020 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f2475062640 1 -- 172.21.15.42:0/1133662994 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0319d0 con 0x7f24700c7020 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 -- 172.21.15.42:0/1133662994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24700c7020 msgr2=0x7f2470156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 --2- 172.21.15.42:0/1133662994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24700c7020 0x7f2470156d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f247015d9c0 tx=0x7f246c02a5f0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 -- 172.21.15.42:0/1133662994 shutdown_connections 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 --2- 172.21.15.42:0/1133662994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f247006daf0 0x7f24700cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 --2- 172.21.15.42:0/1133662994 >> v2:172.21.15.181:3300/0 conn(0x7f247006e990 0x7f247006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 --2- 172.21.15.42:0/1133662994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24700c7020 0x7f2470156d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 -- 172.21.15.42:0/1133662994 >> 172.21.15.42:0/1133662994 conn(0x7f2470068ef0 msgr2=0x7f24700d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:06.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 -- 172.21.15.42:0/1133662994 shutdown_connections 2024-05-09T01:41:06.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.005+0000 7f24782c8640 1 -- 172.21.15.42:0/1133662994 wait complete. 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.007+0000 7f24782c8640 1 Processor -- start 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.007+0000 7f24782c8640 1 -- start start 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f24782c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 0x7f24701f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f24782c8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247006e990 0x7f24701537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f24782c8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24700c7020 0x7f2470158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f24782c8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f247015da90 con 0x7f247006daf0 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f24782c8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24700ce5a0 con 0x7f247006e990 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f24782c8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f24700b4cb0 con 0x7f24700c7020 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.008+0000 7f2476064640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 0x7f24701f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 0x7f24701f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47192/0 (socket says 172.21.15.42:47192) 2024-05-09T01:41:06.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 -- 172.21.15.42:0/2188472308 learned_addr learned my addr 172.21.15.42:0/2188472308 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476865640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24700c7020 0x7f2470158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2475863640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247006e990 0x7f24701537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 -- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24700c7020 msgr2=0x7f2470158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24700c7020 0x7f2470158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 -- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247006e990 msgr2=0x7f24701537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247006e990 0x7f24701537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 -- 172.21.15.42:0/2188472308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2470153ce0 con 0x7f247006daf0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2476064640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 0x7f24701f36f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f246c034040 tx=0x7f246c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c036050 con 0x7f247006daf0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c042070 con 0x7f247006daf0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247015a1b0 con 0x7f247006daf0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c009510 con 0x7f247006daf0 2024-05-09T01:41:06.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.009+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2470152cc0 con 0x7f247006daf0 2024-05-09T01:41:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.010+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24700ce250 con 0x7f247006daf0 2024-05-09T01:41:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.011+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f246c007c50 con 0x7f247006daf0 2024-05-09T01:41:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.012+0000 7f2466ffd640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f24540762d0 0x7f24540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.012+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f246c0b8480 con 0x7f247006daf0 2024-05-09T01:41:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.012+0000 7f2475863640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f24540762d0 0x7f24540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.012+0000 7f2475863640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f24540762d0 0x7f24540787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24701566a0 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.016+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f246c081de0 con 0x7f247006daf0 2024-05-09T01:41:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.205+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f247006e0a0 con 0x7f24540762d0 2024-05-09T01:41:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.213+0000 7f2466ffd640 1 -- 172.21.15.42:0/2188472308 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251819 (secure 0 0 0) 0x7f247006e0a0 con 0x7f24540762d0 2024-05-09T01:41:06.213 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:06.214 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f24540762d0 msgr2=0x7f24540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f24540762d0 0x7f24540787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24701566a0 tx=0x7f2460008040 comp rx=0 tx=0).stop 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 msgr2=0x7f24701f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 0x7f24701f36f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f246c034040 tx=0x7f246c004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 shutdown_connections 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f24540762d0 0x7f24540787e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24700c7020 0x7f2470158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247006e990 0x7f24701537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 --2- 172.21.15.42:0/2188472308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f247006daf0 0x7f24701f36f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 >> 172.21.15.42:0/2188472308 conn(0x7f2470068ef0 msgr2=0x7f2470155740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 shutdown_connections 2024-05-09T01:41:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.216+0000 7f24782c8640 1 -- 172.21.15.42:0/2188472308 wait complete. 2024-05-09T01:41:06.225 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-09T01:41:04.214386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239724,"kb_used_data":2732,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734996,"statfs":{"total":773094113280,"available":772848635904,"internally_reserved":0,"allocated":2797568,"data_stored":1736876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001762"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763307+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:40:59.763307+0000","last_peered":"2024-05-09T01:40:59.763307+0000","last_clean":"2024-05-09T01:40:59.763307+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:40:59.763307+0000","last_undegraded":"2024-05-09T01:40:59.763307+0000","last_fullsized":"2024-05-09T01:40:59.763307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:55.998346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.760843+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:40:59.760843+0000","last_peered":"2024-05-09T01:40:59.760843+0000","last_clean":"2024-05-09T01:40:59.760843+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:40:59.760843+0000","last_undegraded":"2024-05-09T01:40:59.760843+0000","last_fullsized":"2024-05-09T01:40:59.760843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:35.050021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763048+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:40:59.763048+0000","last_peered":"2024-05-09T01:40:59.763048+0000","last_clean":"2024-05-09T01:40:59.763048+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:40:59.763048+0000","last_undegraded":"2024-05-09T01:40:59.763048+0000","last_fullsized":"2024-05-09T01:40:59.763048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:48.990615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.756269+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:40:59.756269+0000","last_peered":"2024-05-09T01:40:59.756269+0000","last_clean":"2024-05-09T01:40:59.756269+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:40:59.756269+0000","last_undegraded":"2024-05-09T01:40:59.756269+0000","last_fullsized":"2024-05-09T01:40:59.756269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:50.779855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763203+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:40:59.763203+0000","last_peered":"2024-05-09T01:40:59.763203+0000","last_clean":"2024-05-09T01:40:59.763203+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:40:59.763203+0000","last_undegraded":"2024-05-09T01:40:59.763203+0000","last_fullsized":"2024-05-09T01:40:59.763203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:11.155139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763274+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:40:59.763274+0000","last_peered":"2024-05-09T01:40:59.763274+0000","last_clean":"2024-05-09T01:40:59.763274+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:40:59.763274+0000","last_undegraded":"2024-05-09T01:40:59.763274+0000","last_fullsized":"2024-05-09T01:40:59.763274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:04.608902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.761862+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:40:59.761862+0000","last_peered":"2024-05-09T01:40:59.761862+0000","last_clean":"2024-05-09T01:40:59.761862+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:40:59.761862+0000","last_undegraded":"2024-05-09T01:40:59.761862+0000","last_fullsized":"2024-05-09T01:40:59.761862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:37.902244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.759877+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:40:59.759877+0000","last_peered":"2024-05-09T01:40:59.759877+0000","last_clean":"2024-05-09T01:40:59.759877+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:40:59.759877+0000","last_undegraded":"2024-05-09T01:40:59.759877+0000","last_fullsized":"2024-05-09T01:40:59.759877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:50.512826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738559+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:00.738559+0000","last_peered":"2024-05-09T01:41:00.738559+0000","last_clean":"2024-05-09T01:41:00.738559+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:00.738559+0000","last_undegraded":"2024-05-09T01:41:00.738559+0000","last_fullsized":"2024-05-09T01:41:00.738559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763135+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:40:59.763135+0000","last_peered":"2024-05-09T01:40:59.763135+0000","last_clean":"2024-05-09T01:40:59.763135+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:40:59.763135+0000","last_undegraded":"2024-05-09T01:40:59.763135+0000","last_fullsized":"2024-05-09T01:40:59.763135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:16.192794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337139+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:01.337139+0000","last_peered":"2024-05-09T01:41:01.337139+0000","last_clean":"2024-05-09T01:41:01.337139+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:01.337139+0000","last_undegraded":"2024-05-09T01:41:01.337139+0000","last_fullsized":"2024-05-09T01:41:01.337139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738548+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:00.738548+0000","last_peered":"2024-05-09T01:41:00.738548+0000","last_clean":"2024-05-09T01:41:00.738548+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:00.738548+0000","last_undegraded":"2024-05-09T01:41:00.738548+0000","last_fullsized":"2024-05-09T01:41:00.738548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396872+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:01.396872+0000","last_peered":"2024-05-09T01:41:01.396872+0000","last_clean":"2024-05-09T01:41:01.396872+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:01.396872+0000","last_undegraded":"2024-05-09T01:41:01.396872+0000","last_fullsized":"2024-05-09T01:41:01.396872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337492+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:01.337492+0000","last_peered":"2024-05-09T01:41:01.337492+0000","last_clean":"2024-05-09T01:41:01.337492+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:01.337492+0000","last_undegraded":"2024-05-09T01:41:01.337492+0000","last_fullsized":"2024-05-09T01:41:01.337492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397065+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:01.397065+0000","last_peered":"2024-05-09T01:41:01.397065+0000","last_clean":"2024-05-09T01:41:01.397065+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:01.397065+0000","last_undegraded":"2024-05-09T01:41:01.397065+0000","last_fullsized":"2024-05-09T01:41:01.397065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763946+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:40:59.763946+0000","last_peered":"2024-05-09T01:40:59.763946+0000","last_clean":"2024-05-09T01:40:59.763946+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:40:59.763946+0000","last_undegraded":"2024-05-09T01:40:59.763946+0000","last_fullsized":"2024-05-09T01:40:59.763946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:44.069056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.765422+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:40:59.765422+0000","last_peered":"2024-05-09T01:40:59.765422+0000","last_clean":"2024-05-09T01:40:59.765422+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:40:59.765422+0000","last_undegraded":"2024-05-09T01:40:59.765422+0000","last_fullsized":"2024-05-09T01:40:59.765422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:14.741205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337329+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:01.337329+0000","last_peered":"2024-05-09T01:41:01.337329+0000","last_clean":"2024-05-09T01:41:01.337329+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:01.337329+0000","last_undegraded":"2024-05-09T01:41:01.337329+0000","last_fullsized":"2024-05-09T01:41:01.337329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.744549+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:40:59.744549+0000","last_peered":"2024-05-09T01:40:59.744549+0000","last_clean":"2024-05-09T01:40:59.744549+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:40:59.744549+0000","last_undegraded":"2024-05-09T01:40:59.744549+0000","last_fullsized":"2024-05-09T01:40:59.744549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763205+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:40:59.763205+0000","last_peered":"2024-05-09T01:40:59.763205+0000","last_clean":"2024-05-09T01:40:59.763205+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:40:59.763205+0000","last_undegraded":"2024-05-09T01:40:59.763205+0000","last_fullsized":"2024-05-09T01:40:59.763205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:12:17.883144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397392+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:01.397392+0000","last_peered":"2024-05-09T01:41:01.397392+0000","last_clean":"2024-05-09T01:41:01.397392+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:01.397392+0000","last_undegraded":"2024-05-09T01:41:01.397392+0000","last_fullsized":"2024-05-09T01:41:01.397392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337112+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:01.337112+0000","last_peered":"2024-05-09T01:41:01.337112+0000","last_clean":"2024-05-09T01:41:01.337112+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:01.337112+0000","last_undegraded":"2024-05-09T01:41:01.337112+0000","last_fullsized":"2024-05-09T01:41:01.337112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.742646+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:40:59.742646+0000","last_peered":"2024-05-09T01:40:59.742646+0000","last_clean":"2024-05-09T01:40:59.742646+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:40:59.742646+0000","last_undegraded":"2024-05-09T01:40:59.742646+0000","last_fullsized":"2024-05-09T01:40:59.742646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.745080+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:40:59.745080+0000","last_peered":"2024-05-09T01:40:59.745080+0000","last_clean":"2024-05-09T01:40:59.745080+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:40:59.745080+0000","last_undegraded":"2024-05-09T01:40:59.745080+0000","last_fullsized":"2024-05-09T01:40:59.745080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.743410+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:40:59.743410+0000","last_peered":"2024-05-09T01:40:59.743410+0000","last_clean":"2024-05-09T01:40:59.743410+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:40:59.743410+0000","last_undegraded":"2024-05-09T01:40:59.743410+0000","last_fullsized":"2024-05-09T01:40:59.743410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895608+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:00.895608+0000","last_peered":"2024-05-09T01:41:00.895608+0000","last_clean":"2024-05-09T01:41:00.895608+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:00.895608+0000","last_undegraded":"2024-05-09T01:41:00.895608+0000","last_fullsized":"2024-05-09T01:41:00.895608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.744240+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:40:59.744240+0000","last_peered":"2024-05-09T01:40:59.744240+0000","last_clean":"2024-05-09T01:40:59.744240+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:40:59.744240+0000","last_undegraded":"2024-05-09T01:40:59.744240+0000","last_fullsized":"2024-05-09T01:40:59.744240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397003+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:01.397003+0000","last_peered":"2024-05-09T01:41:01.397003+0000","last_clean":"2024-05-09T01:41:01.397003+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:01.397003+0000","last_undegraded":"2024-05-09T01:41:01.397003+0000","last_fullsized":"2024-05-09T01:41:01.397003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742686+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:00.742686+0000","last_peered":"2024-05-09T01:41:00.742686+0000","last_clean":"2024-05-09T01:41:00.742686+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:00.742686+0000","last_undegraded":"2024-05-09T01:41:00.742686+0000","last_fullsized":"2024-05-09T01:41:00.742686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.762969+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:40:59.762969+0000","last_peered":"2024-05-09T01:40:59.762969+0000","last_clean":"2024-05-09T01:40:59.762969+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:40:59.762969+0000","last_undegraded":"2024-05-09T01:40:59.762969+0000","last_fullsized":"2024-05-09T01:40:59.762969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:49.825059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.744849+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:40:59.744849+0000","last_peered":"2024-05-09T01:40:59.744849+0000","last_clean":"2024-05-09T01:40:59.744849+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:40:59.744849+0000","last_undegraded":"2024-05-09T01:40:59.744849+0000","last_fullsized":"2024-05-09T01:40:59.744849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397483+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:01.397483+0000","last_peered":"2024-05-09T01:41:01.397483+0000","last_clean":"2024-05-09T01:41:01.397483+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:01.397483+0000","last_undegraded":"2024-05-09T01:41:01.397483+0000","last_fullsized":"2024-05-09T01:41:01.397483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.765336+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:40:59.765336+0000","last_peered":"2024-05-09T01:40:59.765336+0000","last_clean":"2024-05-09T01:40:59.765336+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:40:59.765336+0000","last_undegraded":"2024-05-09T01:40:59.765336+0000","last_fullsized":"2024-05-09T01:40:59.765336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:25.981579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895471+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:00.895471+0000","last_peered":"2024-05-09T01:41:00.895471+0000","last_clean":"2024-05-09T01:41:00.895471+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:00.895471+0000","last_undegraded":"2024-05-09T01:41:00.895471+0000","last_fullsized":"2024-05-09T01:41:00.895471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743341+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:00.743341+0000","last_peered":"2024-05-09T01:41:00.743341+0000","last_clean":"2024-05-09T01:41:00.743341+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:00.743341+0000","last_undegraded":"2024-05-09T01:41:00.743341+0000","last_fullsized":"2024-05-09T01:41:00.743341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895677+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:00.895677+0000","last_peered":"2024-05-09T01:41:00.895677+0000","last_clean":"2024-05-09T01:41:00.895677+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:00.895677+0000","last_undegraded":"2024-05-09T01:41:00.895677+0000","last_fullsized":"2024-05-09T01:41:00.895677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337554+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:01.337554+0000","last_peered":"2024-05-09T01:41:01.337554+0000","last_clean":"2024-05-09T01:41:01.337554+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:01.337554+0000","last_undegraded":"2024-05-09T01:41:01.337554+0000","last_fullsized":"2024-05-09T01:41:01.337554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763099+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:40:59.763099+0000","last_peered":"2024-05-09T01:40:59.763099+0000","last_clean":"2024-05-09T01:40:59.763099+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:40:59.763099+0000","last_undegraded":"2024-05-09T01:40:59.763099+0000","last_fullsized":"2024-05-09T01:40:59.763099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:59.150456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742602+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:00.742602+0000","last_peered":"2024-05-09T01:41:00.742602+0000","last_clean":"2024-05-09T01:41:00.742602+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:00.742602+0000","last_undegraded":"2024-05-09T01:41:00.742602+0000","last_fullsized":"2024-05-09T01:41:00.742602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.756281+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:40:59.756281+0000","last_peered":"2024-05-09T01:40:59.756281+0000","last_clean":"2024-05-09T01:40:59.756281+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:40:59.756281+0000","last_undegraded":"2024-05-09T01:40:59.756281+0000","last_fullsized":"2024-05-09T01:40:59.756281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:14.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895494+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:00.895494+0000","last_peered":"2024-05-09T01:41:00.895494+0000","last_clean":"2024-05-09T01:41:00.895494+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:00.895494+0000","last_undegraded":"2024-05-09T01:41:00.895494+0000","last_fullsized":"2024-05-09T01:41:00.895494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895478+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:00.895478+0000","last_peered":"2024-05-09T01:41:00.895478+0000","last_clean":"2024-05-09T01:41:00.895478+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:00.895478+0000","last_undegraded":"2024-05-09T01:41:00.895478+0000","last_fullsized":"2024-05-09T01:41:00.895478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743040+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:00.743040+0000","last_peered":"2024-05-09T01:41:00.743040+0000","last_clean":"2024-05-09T01:41:00.743040+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:00.743040+0000","last_undegraded":"2024-05-09T01:41:00.743040+0000","last_fullsized":"2024-05-09T01:41:00.743040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742932+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:00.742932+0000","last_peered":"2024-05-09T01:41:00.742932+0000","last_clean":"2024-05-09T01:41:00.742932+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:00.742932+0000","last_undegraded":"2024-05-09T01:41:00.742932+0000","last_fullsized":"2024-05-09T01:41:00.742932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743198+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:00.743198+0000","last_peered":"2024-05-09T01:41:00.743198+0000","last_clean":"2024-05-09T01:41:00.743198+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:00.743198+0000","last_undegraded":"2024-05-09T01:41:00.743198+0000","last_fullsized":"2024-05-09T01:41:00.743198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.763973+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:40:59.763973+0000","last_peered":"2024-05-09T01:40:59.763973+0000","last_clean":"2024-05-09T01:40:59.763973+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:40:59.763973+0000","last_undegraded":"2024-05-09T01:40:59.763973+0000","last_fullsized":"2024-05-09T01:40:59.763973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:44.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738369+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:00.738369+0000","last_peered":"2024-05-09T01:41:00.738369+0000","last_clean":"2024-05-09T01:41:00.738369+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:00.738369+0000","last_undegraded":"2024-05-09T01:41:00.738369+0000","last_fullsized":"2024-05-09T01:41:00.738369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T01:40:59.743458+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:40:59.743458+0000","last_peered":"2024-05-09T01:40:59.743458+0000","last_clean":"2024-05-09T01:40:59.743458+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:40:59.743458+0000","last_undegraded":"2024-05-09T01:40:59.743458+0000","last_fullsized":"2024-05-09T01:40:59.743458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":663823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":657523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":67155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:06.229 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T01:41:06.229 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T01:41:06.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T01:41:06.229 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T01:41:06.229 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T01:41:06.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.383+0000 7fd575334640 1 Processor -- start 2024-05-09T01:41:06.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.383+0000 7fd575334640 1 -- start start 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd575334640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700c9500 0x7fd5700ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd575334640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd5700b7ba0 0x7fd5701570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd575334640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd5700c9a80 0x7fd5700c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd575334640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd5701612f0 con 0x7fd5700b7ba0 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd575334640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd5700cc350 con 0x7fd5700c9a80 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd575334640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd570160420 con 0x7fd5700c9500 2024-05-09T01:41:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd567fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd5700b7ba0 0x7fd5701570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd567fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd5700b7ba0 0x7fd5701570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47198/0 (socket says 172.21.15.42:47198) 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd567fff640 1 -- 172.21.15.42:0/197519110 learned_addr learned my addr 172.21.15.42:0/197519110 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd56f7fe640 1 --2- 172.21.15.42:0/197519110 >> v2:172.21.15.181:3300/0 conn(0x7fd5700c9a80 0x7fd5700c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.384+0000 7fd56effd640 1 --2- 172.21.15.42:0/197519110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700c9500 0x7fd5700ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd567fff640 1 -- 172.21.15.42:0/197519110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700c9500 msgr2=0x7fd5700ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd567fff640 1 --2- 172.21.15.42:0/197519110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700c9500 0x7fd5700ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd567fff640 1 -- 172.21.15.42:0/197519110 >> v2:172.21.15.181:3300/0 conn(0x7fd5700c9a80 msgr2=0x7fd5700c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd567fff640 1 --2- 172.21.15.42:0/197519110 >> v2:172.21.15.181:3300/0 conn(0x7fd5700c9a80 0x7fd5700c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd567fff640 1 -- 172.21.15.42:0/197519110 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5701606e0 con 0x7fd5700b7ba0 2024-05-09T01:41:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd567fff640 1 --2- 172.21.15.42:0/197519110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700b7ba0 0x7fd5701570f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5700c5730 tx=0x7fd55802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9d743dcc00ab29 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.385+0000 7fd56e7fc640 1 -- 172.21.15.42:0/197519110 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037070 con 0x7fd5700b7ba0 2024-05-09T01:41:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd56e7fc640 1 -- 172.21.15.42:0/197519110 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd558032440 con 0x7fd5700b7ba0 2024-05-09T01:41:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd56e7fc640 1 -- 172.21.15.42:0/197519110 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558032810 con 0x7fd5700b7ba0 2024-05-09T01:41:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 -- 172.21.15.42:0/197519110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700b7ba0 msgr2=0x7fd5701570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 --2- 172.21.15.42:0/197519110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700b7ba0 0x7fd5701570f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5700c5730 tx=0x7fd55802a1e0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 -- 172.21.15.42:0/197519110 shutdown_connections 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 --2- 172.21.15.42:0/197519110 >> v2:172.21.15.181:3300/0 conn(0x7fd5700c9a80 0x7fd5700c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 --2- 172.21.15.42:0/197519110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700b7ba0 0x7fd5701570f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 --2- 172.21.15.42:0/197519110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700c9500 0x7fd5700ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 -- 172.21.15.42:0/197519110 >> 172.21.15.42:0/197519110 conn(0x7fd5700d2100 msgr2=0x7fd5700d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 -- 172.21.15.42:0/197519110 shutdown_connections 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.386+0000 7fd575334640 1 -- 172.21.15.42:0/197519110 wait complete. 2024-05-09T01:41:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.388+0000 7fd575334640 1 Processor -- start 2024-05-09T01:41:06.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.388+0000 7fd575334640 1 -- start start 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd575334640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700b7ba0 0x7fd570158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd575334640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 0x7fd570159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd575334640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5700c9a80 0x7fd5701501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd575334640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd570160f80 con 0x7fd5700c9500 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd575334640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd570160ca0 con 0x7fd5700c9a80 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd575334640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd5700ca870 con 0x7fd5700b7ba0 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd567fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 0x7fd570159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd567fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 0x7fd570159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47202/0 (socket says 172.21.15.42:47202) 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.389+0000 7fd567fff640 1 -- 172.21.15.42:0/515429516 learned_addr learned my addr 172.21.15.42:0/515429516 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd56f7fe640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5700c9a80 0x7fd5701501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd56effd640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700b7ba0 0x7fd570158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd567fff640 1 -- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700b7ba0 msgr2=0x7fd570158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd567fff640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700b7ba0 0x7fd570158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd567fff640 1 -- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5700c9a80 msgr2=0x7fd5701501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd567fff640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5700c9a80 0x7fd5701501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd567fff640 1 -- 172.21.15.42:0/515429516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5700c7b70 con 0x7fd5700c9500 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd567fff640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 0x7fd570159cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd55802a220 tx=0x7fd5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558041020 con 0x7fd5700c9500 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5580306c0 con 0x7fd5700c9500 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd570158bc0 con 0x7fd5700c9500 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037040 con 0x7fd5700c9500 2024-05-09T01:41:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.390+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd570157e80 con 0x7fd5700c9500 2024-05-09T01:41:06.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.391+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd570159a40 con 0x7fd5700c9500 2024-05-09T01:41:06.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.392+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd558044020 con 0x7fd5700c9500 2024-05-09T01:41:06.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.392+0000 7fd5677fe640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd5500762d0 0x7fd5500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.392+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5580b7e10 con 0x7fd5700c9500 2024-05-09T01:41:06.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.393+0000 7fd56effd640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd5500762d0 0x7fd5500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.393+0000 7fd56effd640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd5500762d0 0x7fd5500787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5600079a0 tx=0x7fd560008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.397+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5580bb030 con 0x7fd5700c9500 2024-05-09T01:41:06.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.636+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd5700c84c0 con 0x7fd5700c9500 2024-05-09T01:41:06.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.639+0000 7fd5677fe640 1 -- 172.21.15.42:0/515429516 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189524 (secure 0 0 0) 0x7fd55804b030 con 0x7fd5700c9500 2024-05-09T01:41:06.639 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:06.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd5500762d0 msgr2=0x7fd5500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd5500762d0 0x7fd5500787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5600079a0 tx=0x7fd560008040 comp rx=0 tx=0).stop 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 msgr2=0x7fd570159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 0x7fd570159cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd55802a220 tx=0x7fd5580046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 shutdown_connections 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd5500762d0 0x7fd5500787e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5700c9a80 0x7fd5701501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5700c9500 0x7fd570159cf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 --2- 172.21.15.42:0/515429516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5700b7ba0 0x7fd570158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 >> 172.21.15.42:0/515429516 conn(0x7fd5700d2100 msgr2=0x7fd5700c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 shutdown_connections 2024-05-09T01:41:06.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.642+0000 7fd575334640 1 -- 172.21.15.42:0/515429516 wait complete. 2024-05-09T01:41:06.651 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":112467660},{"type":"v1","addr":"172.21.15.181:6833","nonce":112467660}]},"active_addr":"172.21.15.181:6833/112467660","active_change":"2024-05-09T01:40:40.201854+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":1131122944}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":2164812116}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":354017614}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3525788816}]}]} 2024-05-09T01:41:06.654 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T01:41:06.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T01:41:06.654 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:41:06.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.772+0000 7f037f3b4640 1 Processor -- start 2024-05-09T01:41:06.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.773+0000 7f037f3b4640 1 -- start start 2024-05-09T01:41:06.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037f3b4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03780c9500 0x7f03780ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037f3b4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f03780b7ba0 0x7f03781570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037f3b4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f03780c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037f3b4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f03781612f0 con 0x7f03780c9500 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037f3b4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f03780cc350 con 0x7f03780b7ba0 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037f3b4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0378160420 con 0x7f03780c9a80 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03780c9500 0x7f03780ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03780c9500 0x7f03780ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47214/0 (socket says 172.21.15.42:47214) 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 -- 172.21.15.42:0/375525668 learned_addr learned my addr 172.21.15.42:0/375525668 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037c94f640 1 --2- 172.21.15.42:0/375525668 >> v2:172.21.15.181:3300/0 conn(0x7f03780b7ba0 0x7f03781570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d951640 1 --2- 172.21.15.42:0/375525668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f03780c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 -- 172.21.15.42:0/375525668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 msgr2=0x7f03780c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 --2- 172.21.15.42:0/375525668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f03780c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 -- 172.21.15.42:0/375525668 >> v2:172.21.15.181:3300/0 conn(0x7f03780b7ba0 msgr2=0x7f03781570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 --2- 172.21.15.42:0/375525668 >> v2:172.21.15.181:3300/0 conn(0x7f03780b7ba0 0x7f03781570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037d150640 1 -- 172.21.15.42:0/375525668 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03781606e0 con 0x7f03780c9500 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.774+0000 7f037c94f640 1 --2- 172.21.15.42:0/375525668 >> v2:172.21.15.181:3300/0 conn(0x7f03780b7ba0 0x7f03781570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.775+0000 7f037d150640 1 --2- 172.21.15.42:0/375525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780c9500 0x7f03780ce4b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f037806ebb0 tx=0x7f037402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7072534901e6e33 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.775+0000 7f036ffff640 1 -- 172.21.15.42:0/375525668 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374037070 con 0x7f03780c9500 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.775+0000 7f036ffff640 1 -- 172.21.15.42:0/375525668 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0374032440 con 0x7f03780c9500 2024-05-09T01:41:06.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.775+0000 7f036ffff640 1 -- 172.21.15.42:0/375525668 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374032810 con 0x7f03780c9500 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 -- 172.21.15.42:0/375525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780c9500 msgr2=0x7f03780ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 --2- 172.21.15.42:0/375525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780c9500 0x7f03780ce4b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f037806ebb0 tx=0x7f037402a1e0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 -- 172.21.15.42:0/375525668 shutdown_connections 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 --2- 172.21.15.42:0/375525668 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f03780c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 --2- 172.21.15.42:0/375525668 >> v2:172.21.15.181:3300/0 conn(0x7f03780b7ba0 0x7f03781570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 --2- 172.21.15.42:0/375525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780c9500 0x7f03780ce4b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 -- 172.21.15.42:0/375525668 >> 172.21.15.42:0/375525668 conn(0x7f03780d2100 msgr2=0x7f03780d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 -- 172.21.15.42:0/375525668 shutdown_connections 2024-05-09T01:41:06.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.776+0000 7f037f3b4640 1 -- 172.21.15.42:0/375525668 wait complete. 2024-05-09T01:41:06.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.778+0000 7f037f3b4640 1 Processor -- start 2024-05-09T01:41:06.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.778+0000 7f037f3b4640 1 -- start start 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037f3b4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 0x7f03780d1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037f3b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03780c9500 0x7f03781e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037f3b4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f0378150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037f3b4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0378160f80 con 0x7f03780b7ba0 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037f3b4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0378160ca0 con 0x7f03780c9500 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037f3b4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f03780ca870 con 0x7f03780c9a80 2024-05-09T01:41:06.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037d150640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 0x7f03780d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037d150640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 0x7f03780d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47226/0 (socket says 172.21.15.42:47226) 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.779+0000 7f037d150640 1 -- 172.21.15.42:0/1157012428 learned_addr learned my addr 172.21.15.42:0/1157012428 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037c94f640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03780c9500 0x7f03781e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d951640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f0378150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d150640 1 -- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 msgr2=0x7f0378150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d150640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f0378150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d150640 1 -- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03780c9500 msgr2=0x7f03781e8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d150640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03780c9500 0x7f03781e8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d150640 1 -- 172.21.15.42:0/1157012428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03780d17a0 con 0x7f03780b7ba0 2024-05-09T01:41:06.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.780+0000 7f037d150640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 0x7f03780d1260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0374000c00 tx=0x7f03740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.781+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374041020 con 0x7f03780b7ba0 2024-05-09T01:41:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.781+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03740306c0 con 0x7f03780b7ba0 2024-05-09T01:41:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.781+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0378154940 con 0x7f03780b7ba0 2024-05-09T01:41:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.782+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374037040 con 0x7f03780b7ba0 2024-05-09T01:41:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.782+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0378154ec0 con 0x7f03780b7ba0 2024-05-09T01:41:06.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.783+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03780d0fc0 con 0x7f03780b7ba0 2024-05-09T01:41:06.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.783+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0374044020 con 0x7f03780b7ba0 2024-05-09T01:41:06.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.784+0000 7f036dffb640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f035c076300 0x7f035c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:06.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.784+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f03740b7c70 con 0x7f03780b7ba0 2024-05-09T01:41:06.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.784+0000 7f037c94f640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f035c076300 0x7f035c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:06.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.785+0000 7f037c94f640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f035c076300 0x7f035c078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03780d1f40 tx=0x7f0368008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:06.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.790+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f037404b030 con 0x7f03780b7ba0 2024-05-09T01:41:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.984+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03780cbf50 con 0x7f03780b7ba0 2024-05-09T01:41:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.986+0000 7f036dffb640 1 -- 172.21.15.42:0/1157012428 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f0374080f80 con 0x7f03780b7ba0 2024-05-09T01:41:06.984 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:06.984 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:00.734921+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:06.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f035c076300 msgr2=0x7f035c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f035c076300 0x7f035c078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03780d1f40 tx=0x7f0368008040 comp rx=0 tx=0).stop 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 msgr2=0x7f03780d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 0x7f03780d1260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0374000c00 tx=0x7f03740046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 shutdown_connections 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f035c076300 0x7f035c078810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03780c9a80 0x7f0378150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03780c9500 0x7f03781e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 --2- 172.21.15.42:0/1157012428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03780b7ba0 0x7f03780d1260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 >> 172.21.15.42:0/1157012428 conn(0x7f03780d2100 msgr2=0x7f03781529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:06.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 shutdown_connections 2024-05-09T01:41:06.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:06.988+0000 7f037f3b4640 1 -- 172.21.15.42:0/1157012428 wait complete. 2024-05-09T01:41:06.997 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T01:41:06.997 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:41:07.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.113+0000 7f392b653640 1 Processor -- start 2024-05-09T01:41:07.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.114+0000 7f392b653640 1 -- start start 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f392b653640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3924071be0 0x7f39240c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f392b653640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3924154f30 0x7f392415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f392b653640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39240caa10 con 0x7f3924154b20 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f392b653640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f3924071750 con 0x7f3924154f30 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f392b653640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f39240cb200 con 0x7f3924071be0 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f3929bf0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3924154f30 0x7f392415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f3929bf0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3924154f30 0x7f392415e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47240/0 (socket says 172.21.15.42:47240) 2024-05-09T01:41:07.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f3929bf0640 1 -- 172.21.15.42:0/94695365 learned_addr learned my addr 172.21.15.42:0/94695365 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f39293ef640 1 --2- 172.21.15.42:0/94695365 >> v2:172.21.15.181:3300/0 conn(0x7f3924071be0 0x7f39240c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f3929bf0640 1 -- 172.21.15.42:0/94695365 >> v2:172.21.15.181:3300/0 conn(0x7f3924071be0 msgr2=0x7f39240c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f3929bf0640 1 --2- 172.21.15.42:0/94695365 >> v2:172.21.15.181:3300/0 conn(0x7f3924071be0 0x7f39240c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.115+0000 7f3929bf0640 1 -- 172.21.15.42:0/94695365 >> v1:172.21.15.181:6789/0 conn(0x7f3924154b20 legacy=0x7f392415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.116+0000 7f3929bf0640 1 -- 172.21.15.42:0/94695365 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240cb740 con 0x7f3924154f30 2024-05-09T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.116+0000 7f3929bf0640 1 --2- 172.21.15.42:0/94695365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154f30 0x7f392415e7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39240ca660 tx=0x7f391c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3551198be9ad44f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.116+0000 7f391bfff640 1 -- 172.21.15.42:0/94695365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c036070 con 0x7f3924154f30 2024-05-09T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.116+0000 7f391bfff640 1 -- 172.21.15.42:0/94695365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c031600 con 0x7f3924154f30 2024-05-09T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.116+0000 7f391bfff640 1 -- 172.21.15.42:0/94695365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c0319d0 con 0x7f3924154f30 2024-05-09T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 -- 172.21.15.42:0/94695365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154f30 msgr2=0x7f392415e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 --2- 172.21.15.42:0/94695365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154f30 0x7f392415e7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39240ca660 tx=0x7f391c02a730 comp rx=0 tx=0).stop 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 -- 172.21.15.42:0/94695365 shutdown_connections 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 --2- 172.21.15.42:0/94695365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154f30 0x7f392415e7b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 --2- 172.21.15.42:0/94695365 >> v2:172.21.15.181:3300/0 conn(0x7f3924071be0 0x7f39240c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 -- 172.21.15.42:0/94695365 >> 172.21.15.42:0/94695365 conn(0x7f39240d0660 msgr2=0x7f3924072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 -- 172.21.15.42:0/94695365 shutdown_connections 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.117+0000 7f392b653640 1 -- 172.21.15.42:0/94695365 wait complete. 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.119+0000 7f392b653640 1 Processor -- start 2024-05-09T01:41:07.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.119+0000 7f392b653640 1 -- start start 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.120+0000 7f392b653640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3924071be0 0x7f392414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.120+0000 7f392b653640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 0x7f39240b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.120+0000 7f392b653640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3924155d60 0x7f392414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.120+0000 7f392b653640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39240713e0 con 0x7f3924154b20 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.120+0000 7f392b653640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3924071100 con 0x7f3924071be0 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.120+0000 7f392b653640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f39240c5780 con 0x7f3924155d60 2024-05-09T01:41:07.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 0x7f39240b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 0x7f39240b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47246/0 (socket says 172.21.15.42:47246) 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 -- 172.21.15.42:0/2058002489 learned_addr learned my addr 172.21.15.42:0/2058002489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f39293ef640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3924071be0 0x7f392414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3929bf0640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3924155d60 0x7f392414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 -- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3924155d60 msgr2=0x7f392414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3924155d60 0x7f392414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 -- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3924071be0 msgr2=0x7f392414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3924071be0 0x7f392414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 -- 172.21.15.42:0/2058002489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240b4770 con 0x7f3924154b20 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3929bf0640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3924155d60 0x7f392414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3928bee640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 0x7f39240b4230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f391400c3a0 tx=0x7f391400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39140052d0 con 0x7f3924154b20 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3914007020 con 0x7f3924154b20 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39241f0ce0 con 0x7f3924154b20 2024-05-09T01:41:07.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39140054b0 con 0x7f3924154b20 2024-05-09T01:41:07.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.121+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39241f12a0 con 0x7f3924154b20 2024-05-09T01:41:07.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.122+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392414b1d0 con 0x7f3924154b20 2024-05-09T01:41:07.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.123+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3914007410 con 0x7f3924154b20 2024-05-09T01:41:07.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.124+0000 7f3919ffb640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3908076300 0x7f3908078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.124+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3914096a70 con 0x7f3924154b20 2024-05-09T01:41:07.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.124+0000 7f39293ef640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3908076300 0x7f3908078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.124+0000 7f39293ef640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3908076300 0x7f3908078810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39200079a0 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.128+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f391405fc50 con 0x7f3924154b20 2024-05-09T01:41:07.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.324+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39240cbcc0 con 0x7f3924154b20 2024-05-09T01:41:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.325+0000 7f3919ffb640 1 -- 172.21.15.42:0/2058002489 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f3914068320 con 0x7f3924154b20 2024-05-09T01:41:07.323 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:07.323 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:00.734921+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3908076300 msgr2=0x7f3908078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3908076300 0x7f3908078810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39200079a0 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-05-09T01:41:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 msgr2=0x7f39240b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 0x7f39240b4230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f391400c3a0 tx=0x7f391400c860 comp rx=0 tx=0).stop 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 shutdown_connections 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3908076300 0x7f3908078810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3924155d60 0x7f392414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3924154b20 0x7f39240b4230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 --2- 172.21.15.42:0/2058002489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3924071be0 0x7f392414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 >> 172.21.15.42:0/2058002489 conn(0x7f39240d0660 msgr2=0x7f3924152170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 shutdown_connections 2024-05-09T01:41:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.328+0000 7f392b653640 1 -- 172.21.15.42:0/2058002489 wait complete. 2024-05-09T01:41:07.337 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T01:41:07.337 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T01:41:07.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T01:41:07.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T01:41:07.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T01:41:07.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T01:41:07.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T01:41:07.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T01:41:07.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.570+0000 7f77211ea640 1 Processor -- start 2024-05-09T01:41:07.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.570+0000 7f77211ea640 1 -- start start 2024-05-09T01:41:07.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.572+0000 7f77211ea640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0cd5a0 0x7f771c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.572+0000 7f77211ea640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771c0c9460 con 0x7f771c0c51e0 2024-05-09T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.572+0000 7f77211ea640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771c0cc9c0 con 0x7f771c0ca300 2024-05-09T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.572+0000 7f77211ea640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f771c0c4660 con 0x7f771c0cd5a0 2024-05-09T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f771bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0cd5a0 0x7f771c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f548713b640 1 Processor -- start 2024-05-09T01:41:07.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f548713b640 1 -- start start 2024-05-09T01:41:07.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f77209e9640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f771c0c51e0 0x7f771c16b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45776/0 (socket says 172.21.15.42:45776) 2024-05-09T01:41:07.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f77209e9640 1 -- 172.21.15.42:0/1663246443 learned_addr learned my addr 172.21.15.42:0/1663246443 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f2a11d65640 1 Processor -- start 2024-05-09T01:41:07.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.573+0000 7f2a11d65640 1 -- start start 2024-05-09T01:41:07.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.574+0000 7f771bfff640 1 -- 172.21.15.42:0/1663246443 >> v1:172.21.15.181:6789/0 conn(0x7f771c0ca300 legacy=0x7f771c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.574+0000 7f771bfff640 1 -- 172.21.15.42:0/1663246443 >> v1:172.21.15.42:6789/0 conn(0x7f771c0c51e0 legacy=0x7f771c16b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.574+0000 7f771bfff640 1 -- 172.21.15.42:0/1663246443 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c0ccca0 con 0x7f771c0cd5a0 2024-05-09T01:41:07.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.574+0000 7fcdfc2a1640 1 Processor -- start 2024-05-09T01:41:07.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.574+0000 7fcdfc2a1640 1 -- start start 2024-05-09T01:41:07.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.575+0000 7f508a0b8640 1 Processor -- start 2024-05-09T01:41:07.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.575+0000 7f508a0b8640 1 -- start start 2024-05-09T01:41:07.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.575+0000 7f771bfff640 1 --2- 172.21.15.42:0/1663246443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0cd5a0 0x7f771c0cb270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097d0 tx=0x7f770c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21cc2218ba750a8c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.575+0000 7f6697ca8640 1 Processor -- start 2024-05-09T01:41:07.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.575+0000 7f771affd640 1 -- 172.21.15.42:0/1663246443 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c037070 con 0x7f771c0cd5a0 2024-05-09T01:41:07.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.575+0000 7f771affd640 1 -- 172.21.15.42:0/1663246443 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c02acf0 con 0x7f771c0cd5a0 2024-05-09T01:41:07.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a11d65640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04006cb0 0x7f2a040478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a11d65640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2a0404d1c0 0x7f2a040e6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f6697ca8640 1 -- start start 2024-05-09T01:41:07.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a0bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2a04045be0 0x7f2a0404c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:58038/0 (socket says 172.21.15.42:58038) 2024-05-09T01:41:07.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fcdfc2a1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf40c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a10d63640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04006cb0 0x7f2a040478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a040dc2a0 con 0x7f2a04045be0 2024-05-09T01:41:07.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a11564640 1 --2- 172.21.15.42:0/334807465 >> v2:172.21.15.181:3300/0 conn(0x7f2a0404d1c0 0x7f2a040e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fcdfc2a1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcdf4074220 0x7fcdf4074630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fcdfc2a1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf4073d20 con 0x7fcdf40c5330 2024-05-09T01:41:07.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fcdfc2a1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf40700c0 con 0x7fcdf4074220 2024-05-09T01:41:07.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f310b59e640 1 Processor -- start 2024-05-09T01:41:07.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fcdfc2a1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf4070c40 con 0x7fcdf40c7a30 2024-05-09T01:41:07.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7fcdfa03d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcdf40c5330 0x7fcdf4073550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:58048/0 (socket says 172.21.15.42:58048) 2024-05-09T01:41:07.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7fcdfa03d640 1 -- 172.21.15.42:0/2767158323 learned_addr learned my addr 172.21.15.42:0/2767158323 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f2a0bfff640 1 -- 172.21.15.42:0/334807465 learned_addr learned my addr 172.21.15.42:0/334807465 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f771affd640 1 -- 172.21.15.42:0/1663246443 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c032660 con 0x7f771c0cd5a0 2024-05-09T01:41:07.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f77211ea640 1 -- 172.21.15.42:0/1663246443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0cd5a0 msgr2=0x7f771c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f77211ea640 1 --2- 172.21.15.42:0/1663246443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0cd5a0 0x7f771c0cb270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097d0 tx=0x7f770c02a060 comp rx=0 tx=0).stop 2024-05-09T01:41:07.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fe3758bd640 1 Processor -- start 2024-05-09T01:41:07.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7fcdfa83e640 1 --2- 172.21.15.42:0/2767158323 >> v2:172.21.15.181:3300/0 conn(0x7fcdf4074220 0x7fcdf4074630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7fe3758bd640 1 -- start start 2024-05-09T01:41:07.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2a040339b0 con 0x7f2a0404d1c0 2024-05-09T01:41:07.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7fcdf903b640 1 -- 172.21.15.42:0/2767158323 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738588883 0 0) 0x7fcdf4073d20 con 0x7fcdf40c5330 2024-05-09T01:41:07.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2a04046b90 con 0x7f2a04006cb0 2024-05-09T01:41:07.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7fcdf903b640 1 -- 172.21.15.42:0/2767158323 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde0003520 con 0x7fcdf40c5330 2024-05-09T01:41:07.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f2a0b7fe640 1 -- 172.21.15.42:0/334807465 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545518967 0 0) 0x7f2a040dc2a0 con 0x7f2a04045be0 2024-05-09T01:41:07.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f508a0b8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5084152fe0 0x7f50840c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdfa83e640 1 -- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 msgr2=0x7fcdf40c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdf983c640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf40c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f2a0b7fe640 1 -- 172.21.15.42:0/334807465 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29fc003520 con 0x7f2a04045be0 2024-05-09T01:41:07.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f50837fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5084152fe0 0x7f50840c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6697ca8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6688045800 0x7f66880ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6697ca8640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66880062f0 con 0x7f66880e3700 2024-05-09T01:41:07.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f50837fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5084152fe0 0x7f50840c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42370/0 (socket says 172.21.15.42:42370) 2024-05-09T01:41:07.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6697ca8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6688045c10 con 0x7f6688007650 2024-05-09T01:41:07.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6697ca8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f66880060c0 con 0x7f6688045800 2024-05-09T01:41:07.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdf903b640 1 -- 172.21.15.42:0/2767158323 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854348498 0 0) 0x7fcde0003520 con 0x7fcdf40c5330 2024-05-09T01:41:07.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f5082ffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f50840ce040 0x7f5084158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45780/0 (socket says 172.21.15.42:45780) 2024-05-09T01:41:07.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f50837fe640 1 -- 172.21.15.42:0/2782364275 learned_addr learned my addr 172.21.15.42:0/2782364275 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6695243640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f66880e3700 0x7f668804b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45792/0 (socket says 172.21.15.42:45792) 2024-05-09T01:41:07.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6695243640 1 -- 172.21.15.42:0/602106935 learned_addr learned my addr 172.21.15.42:0/602106935 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f6696245640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6688045800 0x7f66880ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548713b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478006090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548713b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f547804c940 0x7f54780de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548713b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54780df6e0 con 0x7f54780471b0 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548713b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5478033570 con 0x7f547804c940 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdfa83e640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf40c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdfa83e640 1 -- 172.21.15.42:0/2767158323 >> v1:172.21.15.181:6789/0 conn(0x7fcdf40c5330 legacy=0x7fcdf4073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdfa83e640 1 -- 172.21.15.42:0/2767158323 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf4070310 con 0x7fcdf4074220 2024-05-09T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7fcdf983c640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf40c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:07.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50840c9940 con 0x7f50840ce040 2024-05-09T01:41:07.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f2a11564640 1 -- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04006cb0 msgr2=0x7f2a040478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f2a11564640 1 --2- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04006cb0 0x7f2a040478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f2a11564640 1 -- 172.21.15.42:0/334807465 >> v1:172.21.15.181:6789/0 conn(0x7f2a04045be0 legacy=0x7f2a0404c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f6696245640 1 -- 172.21.15.42:0/602106935 >> v1:172.21.15.181:6789/0 conn(0x7f6688007650 legacy=0x7f66880dd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f6696245640 1 -- 172.21.15.42:0/602106935 >> v1:172.21.15.42:6789/0 conn(0x7f66880e3700 legacy=0x7f668804b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f6696245640 1 -- 172.21.15.42:0/602106935 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66880065b0 con 0x7f6688045800 2024-05-09T01:41:07.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f2a11564640 1 -- 172.21.15.42:0/334807465 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a040dc580 con 0x7f2a0404d1c0 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508415cef0 con 0x7f5084159390 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5084072f70 con 0x7f5084152fe0 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548713b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f547804bca0 con 0x7f547800e480 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548693a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f54780471b0 0x7f54780d5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:58026/0 (socket says 172.21.15.42:58026) 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f548693a640 1 -- 172.21.15.42:0/3743119791 learned_addr learned my addr 172.21.15.42:0/3743119791 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.576+0000 7f5485938640 1 --2- 172.21.15.42:0/3743119791 >> v2:172.21.15.42:3300/0 conn(0x7f547804c940 0x7f54780de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f5485938640 1 -- 172.21.15.42:0/3743119791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 msgr2=0x7f5478006090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f5485938640 1 --2- 172.21.15.42:0/3743119791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478006090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f5485938640 1 -- 172.21.15.42:0/3743119791 >> v1:172.21.15.181:6789/0 conn(0x7f54780471b0 legacy=0x7f54780d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f5485938640 1 -- 172.21.15.42:0/3743119791 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547804bf80 con 0x7f547804c940 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.578+0000 7f5485938640 1 --2- 172.21.15.42:0/3743119791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 0x7f54780de910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5470009a00 tx=0x7f547003b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0e51ac2ff5c9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f5485137640 1 -- 172.21.15.42:0/3743119791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470048070 con 0x7f547804c940 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f5485137640 1 -- 172.21.15.42:0/3743119791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547003be30 con 0x7f547804c940 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f5485137640 1 -- 172.21.15.42:0/3743119791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470043640 con 0x7f547804c940 2024-05-09T01:41:07.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.577+0000 7f310b59e640 1 -- start start 2024-05-09T01:41:07.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe3758bd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370152fe0 0x7fe3700c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe3758bd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3700ce040 0x7fe3700ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe3758bd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe370158c80 0x7fe370159090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe3758bd640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe370072f70 con 0x7fe370158c80 2024-05-09T01:41:07.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe3758bd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe3700c9940 con 0x7fe3700ce040 2024-05-09T01:41:07.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe3758bd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe37015cef0 con 0x7fe370152fe0 2024-05-09T01:41:07.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f77211ea640 1 -- 172.21.15.42:0/1663246443 shutdown_connections 2024-05-09T01:41:07.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f77211ea640 1 --2- 172.21.15.42:0/1663246443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0cd5a0 0x7f771c0cb270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f77211ea640 1 -- 172.21.15.42:0/1663246443 >> 172.21.15.42:0/1663246443 conn(0x7f771c06ca90 msgr2=0x7f771c06cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe36e7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3700ce040 0x7fe3700ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f50837fe640 1 -- 172.21.15.42:0/2782364275 >> v1:172.21.15.181:6789/0 conn(0x7f5084159390 legacy=0x7f5084163440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f50837fe640 1 -- 172.21.15.42:0/2782364275 >> v1:172.21.15.42:6789/0 conn(0x7f50840ce040 legacy=0x7f5084158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fcdfa83e640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4074220 0x7fcdf4074630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcde40097a0 tx=0x7fcde402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317ac73c21720165 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f50837fe640 1 -- 172.21.15.42:0/2782364275 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50840c9380 con 0x7f5084152fe0 2024-05-09T01:41:07.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f77211ea640 1 -- 172.21.15.42:0/1663246443 shutdown_connections 2024-05-09T01:41:07.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f2a11564640 1 --2- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a0404d1c0 0x7f2a040e6100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c051ae0 tx=0x7f2a0c0aa3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76b541ba1108efc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f310b59e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104037490 0x7f3104049650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f310b59e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3104050b90 0x7f310404ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f310b59e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31040dfe30 con 0x7f31040d9370 2024-05-09T01:41:07.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f310b59e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f3104049de0 con 0x7f3104050b90 2024-05-09T01:41:07.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7f310b59e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f310404a680 con 0x7f3104037490 2024-05-09T01:41:07.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f77211ea640 1 -- 172.21.15.42:0/1663246443 wait complete. 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe36e7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3700ce040 0x7fe3700ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42384/0 (socket says 172.21.15.42:42384) 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe36e7fc640 1 -- 172.21.15.42:0/1787704248 learned_addr learned my addr 172.21.15.42:0/1787704248 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.579+0000 7fe36f7fe640 1 --2- 172.21.15.42:0/1787704248 >> v2:172.21.15.42:3300/0 conn(0x7fe370158c80 0x7fe370159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7fe36e7fc640 1 -- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370152fe0 msgr2=0x7fe3700c7af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7fe36e7fc640 1 --2- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370152fe0 0x7fe3700c7af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7fe36e7fc640 1 -- 172.21.15.42:0/1787704248 >> v2:172.21.15.42:3300/0 conn(0x7fe370158c80 msgr2=0x7fe370159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7fe36e7fc640 1 --2- 172.21.15.42:0/1787704248 >> v2:172.21.15.42:3300/0 conn(0x7fe370158c80 0x7fe370159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7fe36e7fc640 1 -- 172.21.15.42:0/1787704248 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3700c9380 con 0x7fe3700ce040 2024-05-09T01:41:07.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f2a0b7fe640 1 -- 172.21.15.42:0/334807465 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b0070 con 0x7f2a0404d1c0 2024-05-09T01:41:07.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f6696245640 1 --2- 172.21.15.42:0/602106935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6688045800 0x7f66880ef090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6690051ae0 tx=0x7f66900a7fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeee2c68f1971d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f2a0b7fe640 1 -- 172.21.15.42:0/334807465 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0b4400 con 0x7f2a0404d1c0 2024-05-09T01:41:07.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f2a0b7fe640 1 -- 172.21.15.42:0/334807465 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b4830 con 0x7f2a0404d1c0 2024-05-09T01:41:07.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f548713b640 1 -- 172.21.15.42:0/3743119791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 msgr2=0x7f54780de910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f548713b640 1 --2- 172.21.15.42:0/3743119791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 0x7f54780de910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5470009a00 tx=0x7f547003b2f0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f6694a42640 1 -- 172.21.15.42:0/602106935 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900b5070 con 0x7f6688045800 2024-05-09T01:41:07.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f6694a42640 1 -- 172.21.15.42:0/602106935 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66900a8bd0 con 0x7f6688045800 2024-05-09T01:41:07.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f6694a42640 1 -- 172.21.15.42:0/602106935 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900b0640 con 0x7f6688045800 2024-05-09T01:41:07.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f548713b640 1 -- 172.21.15.42:0/3743119791 shutdown_connections 2024-05-09T01:41:07.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f548713b640 1 --2- 172.21.15.42:0/3743119791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 0x7f54780de910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f548713b640 1 --2- 172.21.15.42:0/3743119791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478006090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f548713b640 1 -- 172.21.15.42:0/3743119791 >> 172.21.15.42:0/3743119791 conn(0x7f54780503b0 msgr2=0x7f54780507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f3109d9b640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f31040d9370 0x7f310404fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45796/0 (socket says 172.21.15.42:45796) 2024-05-09T01:41:07.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f3109d9b640 1 -- 172.21.15.42:0/621075361 learned_addr learned my addr 172.21.15.42:0/621075361 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f310a59c640 1 --2- 172.21.15.42:0/621075361 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104037490 0x7f3104049650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f310ad9d640 1 --2- 172.21.15.42:0/621075361 >> v2:172.21.15.42:3300/0 conn(0x7f3104050b90 0x7f310404ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f310a59c640 1 -- 172.21.15.42:0/621075361 >> v2:172.21.15.42:3300/0 conn(0x7f3104050b90 msgr2=0x7f310404ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f310a59c640 1 --2- 172.21.15.42:0/621075361 >> v2:172.21.15.42:3300/0 conn(0x7f3104050b90 0x7f310404ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f310a59c640 1 -- 172.21.15.42:0/621075361 >> v1:172.21.15.42:6789/0 conn(0x7f31040d9370 legacy=0x7f310404fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.580+0000 7f310a59c640 1 -- 172.21.15.42:0/621075361 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31040e0110 con 0x7f3104037490 2024-05-09T01:41:07.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f50837fe640 1 --2- 172.21.15.42:0/2782364275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 0x7f50840c7af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f507c007360 tx=0x7f507c02c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4cb9b8033711f69 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fe36e7fc640 1 --2- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3700ce040 0x7fe3700ce450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe37006f3b0 tx=0x7fe36000ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71319d171bf1829 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f50827fc640 1 -- 172.21.15.42:0/2782364275 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0089e0 con 0x7f5084152fe0 2024-05-09T01:41:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f50827fc640 1 -- 172.21.15.42:0/2782364275 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c008b80 con 0x7f5084152fe0 2024-05-09T01:41:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f50827fc640 1 -- 172.21.15.42:0/2782364275 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c00a0d0 con 0x7f5084152fe0 2024-05-09T01:41:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fcdf903b640 1 -- 172.21.15.42:0/2767158323 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4037070 con 0x7fcdf4074220 2024-05-09T01:41:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fcdf903b640 1 -- 172.21.15.42:0/2767158323 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde402ab90 con 0x7fcdf4074220 2024-05-09T01:41:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fcdf903b640 1 -- 172.21.15.42:0/2767158323 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00016f0 con 0x7fcdf4074220 2024-05-09T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fe36dffb640 1 -- 172.21.15.42:0/1787704248 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36002d070 con 0x7fe3700ce040 2024-05-09T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fe36dffb640 1 -- 172.21.15.42:0/1787704248 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe360031750 con 0x7fe3700ce040 2024-05-09T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7fe36dffb640 1 -- 172.21.15.42:0/1787704248 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36000be60 con 0x7fe3700ce040 2024-05-09T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f6697ca8640 1 -- 172.21.15.42:0/602106935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6688045800 msgr2=0x7f66880ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f6697ca8640 1 --2- 172.21.15.42:0/602106935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6688045800 0x7f66880ef090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6690051ae0 tx=0x7f66900a7fd0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a0404d1c0 msgr2=0x7f2a040e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.581+0000 7f2a11d65640 1 --2- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a0404d1c0 0x7f2a040e6100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c051ae0 tx=0x7f2a0c0aa3c0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f6697ca8640 1 -- 172.21.15.42:0/602106935 shutdown_connections 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f6697ca8640 1 --2- 172.21.15.42:0/602106935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6688045800 0x7f66880ef090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f6697ca8640 1 -- 172.21.15.42:0/602106935 >> 172.21.15.42:0/602106935 conn(0x7f66880503e0 msgr2=0x7f66880507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f548713b640 1 -- 172.21.15.42:0/3743119791 shutdown_connections 2024-05-09T01:41:07.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f548713b640 1 -- 172.21.15.42:0/3743119791 wait complete. 2024-05-09T01:41:07.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 shutdown_connections 2024-05-09T01:41:07.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f6697ca8640 1 -- 172.21.15.42:0/602106935 shutdown_connections 2024-05-09T01:41:07.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f6697ca8640 1 -- 172.21.15.42:0/602106935 wait complete. 2024-05-09T01:41:07.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f2a11d65640 1 --2- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a0404d1c0 0x7f2a040e6100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f2a11d65640 1 --2- 172.21.15.42:0/334807465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04006cb0 0x7f2a040478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 >> 172.21.15.42:0/334807465 conn(0x7f2a04050c40 msgr2=0x7f2a04051050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 msgr2=0x7f50840c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 --2- 172.21.15.42:0/2782364275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 0x7f50840c7af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f507c007360 tx=0x7f507c02c2c0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 shutdown_connections 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 --2- 172.21.15.42:0/2782364275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 0x7f50840c7af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 >> 172.21.15.42:0/2782364275 conn(0x7f508406c850 msgr2=0x7f508406cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 shutdown_connections 2024-05-09T01:41:07.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 shutdown_connections 2024-05-09T01:41:07.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7fe3758bd640 1 -- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3700ce040 msgr2=0x7fe3700ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7fe3758bd640 1 --2- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3700ce040 0x7fe3700ce450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe37006f3b0 tx=0x7fe36000ace0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f508a0b8640 1 -- 172.21.15.42:0/2782364275 wait complete. 2024-05-09T01:41:07.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7f310a59c640 1 --2- 172.21.15.42:0/621075361 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104037490 0x7f3104049650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f310c051ae0 tx=0x7f310c0b0710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff91fa55134ff581 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4074220 msgr2=0x7fcdf4074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.582+0000 7fcdfc2a1640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4074220 0x7fcdf4074630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcde40097a0 tx=0x7fcde402a100 comp rx=0 tx=0).stop 2024-05-09T01:41:07.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7f77211ea640 1 Processor -- start 2024-05-09T01:41:07.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/2767158323 shutdown_connections 2024-05-09T01:41:07.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fcdfc2a1640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4074220 0x7fcdf4074630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fcdfc2a1640 1 --2- 172.21.15.42:0/2767158323 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf40c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/2767158323 >> 172.21.15.42:0/2767158323 conn(0x7fcdf406cdc0 msgr2=0x7fcdf40cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fe3758bd640 1 -- 172.21.15.42:0/1787704248 shutdown_connections 2024-05-09T01:41:07.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/2767158323 shutdown_connections 2024-05-09T01:41:07.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7f2a11d65640 1 -- 172.21.15.42:0/334807465 wait complete. 2024-05-09T01:41:07.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7f77211ea640 1 -- start start 2024-05-09T01:41:07.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7f310959a640 1 -- 172.21.15.42:0/621075361 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0b7600 con 0x7f3104037490 2024-05-09T01:41:07.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7f310959a640 1 -- 172.21.15.42:0/621075361 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0b77e0 con 0x7f3104037490 2024-05-09T01:41:07.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7f310959a640 1 -- 172.21.15.42:0/621075361 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0b7c50 con 0x7f3104037490 2024-05-09T01:41:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fe3758bd640 1 --2- 172.21.15.42:0/1787704248 >> v2:172.21.15.42:3300/0 conn(0x7fe370158c80 0x7fe370159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fe3758bd640 1 --2- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3700ce040 0x7fe3700ce450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fe3758bd640 1 --2- 172.21.15.42:0/1787704248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370152fe0 0x7fe3700c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fe3758bd640 1 -- 172.21.15.42:0/1787704248 >> 172.21.15.42:0/1787704248 conn(0x7fe37006c850 msgr2=0x7fe37006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.584+0000 7fe3758bd640 1 -- 172.21.15.42:0/1787704248 shutdown_connections 2024-05-09T01:41:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.583+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/2767158323 wait complete. 2024-05-09T01:41:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.584+0000 7fe3758bd640 1 -- 172.21.15.42:0/1787704248 wait complete. 2024-05-09T01:41:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.584+0000 7f6697ca8640 1 Processor -- start 2024-05-09T01:41:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.584+0000 7f6697ca8640 1 -- start start 2024-05-09T01:41:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f548713b640 1 Processor -- start 2024-05-09T01:41:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f548713b640 1 -- start start 2024-05-09T01:41:07.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.584+0000 7f310b59e640 1 -- 172.21.15.42:0/621075361 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104037490 msgr2=0x7f3104049650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.584+0000 7f310b59e640 1 --2- 172.21.15.42:0/621075361 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104037490 0x7f3104049650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f310c051ae0 tx=0x7f310c0b0710 comp rx=0 tx=0).stop 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77211ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f771c0c51e0 0x7f771c162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77211ea640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0ca300 0x7f771c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77211ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f771c0cd5a0 0x7f771c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77211ea640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0b46c0 con 0x7f771c0c51e0 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77211ea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0c9210 con 0x7f771c0cd5a0 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77211ea640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f771c0b4840 con 0x7f771c0ca300 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77209e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f771c0cd5a0 0x7f771c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77209e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f771c0cd5a0 0x7f771c0c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42386/0 (socket says 172.21.15.42:42386) 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f77209e9640 1 -- 172.21.15.42:0/807719200 learned_addr learned my addr 172.21.15.42:0/807719200 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.585+0000 7f771b7fe640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0ca300 0x7f771c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7fcdfc2a1640 1 Processor -- start 2024-05-09T01:41:07.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f508a0b8640 1 Processor -- start 2024-05-09T01:41:07.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7fcdfc2a1640 1 -- start start 2024-05-09T01:41:07.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f77209e9640 1 -- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0ca300 msgr2=0x7f771c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f77209e9640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f771c0ca300 0x7f771c15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f77209e9640 1 -- 172.21.15.42:0/807719200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f771c0c51e0 msgr2=0x7f771c162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f77209e9640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f771c0c51e0 0x7f771c162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f77209e9640 1 -- 172.21.15.42:0/807719200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c162970 con 0x7f771c0cd5a0 2024-05-09T01:41:07.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f2a11d65640 1 Processor -- start 2024-05-09T01:41:07.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f508a0b8640 1 -- start start 2024-05-09T01:41:07.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f2a11d65640 1 -- start start 2024-05-09T01:41:07.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f310b59e640 1 -- 172.21.15.42:0/621075361 shutdown_connections 2024-05-09T01:41:07.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f310b59e640 1 --2- 172.21.15.42:0/621075361 >> v2:172.21.15.42:3300/0 conn(0x7f3104050b90 0x7f310404ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f310b59e640 1 --2- 172.21.15.42:0/621075361 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104037490 0x7f3104049650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f310b59e640 1 -- 172.21.15.42:0/621075361 >> 172.21.15.42:0/621075361 conn(0x7f31040547b0 msgr2=0x7f3104054bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f77209e9640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f771c0cd5a0 0x7f771c0c6a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f771400c870 tx=0x7f771400cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f310b59e640 1 -- 172.21.15.42:0/621075361 shutdown_connections 2024-05-09T01:41:07.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.586+0000 7f310b59e640 1 -- 172.21.15.42:0/621075361 wait complete. 2024-05-09T01:41:07.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6697ca8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6688007650 0x7f668817cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714018070 con 0x7f771c0cd5a0 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f771400a5e0 con 0x7f771c0cd5a0 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771400a990 con 0x7f771c0cd5a0 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f77211ea640 1 -- 172.21.15.42:0/807719200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c164e60 con 0x7f771c0cd5a0 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f77211ea640 1 -- 172.21.15.42:0/807719200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c165100 con 0x7f771c0cd5a0 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6697ca8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6688045800 0x7f66881704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6697ca8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66880e3700 0x7f66880d3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7fe3758bd640 1 Processor -- start 2024-05-09T01:41:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7fe3758bd640 1 -- start start 2024-05-09T01:41:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6695a44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6688007650 0x7f668817cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6695a44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6688007650 0x7f668817cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47300/0 (socket says 172.21.15.42:47300) 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6697ca8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6688006b70 con 0x7f6688007650 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6697ca8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f66880071c0 con 0x7f66880e3700 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6697ca8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6688006e50 con 0x7f6688045800 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.587+0000 7f6695a44640 1 -- 172.21.15.42:0/3948175149 learned_addr learned my addr 172.21.15.42:0/3948175149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f6695243640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6688045800 0x7f66881704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f6695a44640 1 -- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6688045800 msgr2=0x7f66881704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f77211ea640 1 -- 172.21.15.42:0/807719200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f771c06a5e0 con 0x7f771c0cd5a0 2024-05-09T01:41:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f6695a44640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6688045800 0x7f66881704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f6695a44640 1 -- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66880e3700 msgr2=0x7f66880d3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f6695a44640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66880e3700 0x7f66880d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.588+0000 7f6695a44640 1 -- 172.21.15.42:0/3948175149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668817d470 con 0x7f6688007650 2024-05-09T01:41:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f508a0b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50840ce040 0x7f50841eede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f548713b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478171930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f548713b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54780471b0 0x7f5478047730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f548713b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 0x7f54780c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f548713b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5478034160 con 0x7f547804c940 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f548713b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5478034480 con 0x7f54780471b0 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f548713b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f547804c360 con 0x7f547800e480 2024-05-09T01:41:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f2a11d65640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a04006cb0 0x7f2a040c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f508a0b8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 0x7f508414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5486139640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478171930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5486139640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478171930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:47212/0 (socket says 172.21.15.42:47212) 2024-05-09T01:41:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5486139640 1 -- 172.21.15.42:0/778200140 learned_addr learned my addr 172.21.15.42:0/778200140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5485938640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54780471b0 0x7f5478047730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f2a11d65640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04045be0 0x7f2a040d3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f2a10d63640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a04006cb0 0x7f2a040c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f2a10d63640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a04006cb0 0x7f2a040c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42426/0 (socket says 172.21.15.42:42426) 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f2a10d63640 1 -- 172.21.15.42:0/1426314425 learned_addr learned my addr 172.21.15.42:0/1426314425 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f508a0b8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5084159390 0x7f50841536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f508a0b8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50840c9c00 con 0x7f50840ce040 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f508a0b8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5084072c00 con 0x7f5084152fe0 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5083fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5084159390 0x7f50841536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5083fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5084159390 0x7f50841536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:47222/0 (socket says 172.21.15.42:47222) 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f5083fff640 1 -- 172.21.15.42:0/303321761 learned_addr learned my addr 172.21.15.42:0/303321761 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f50841551b0 con 0x7f5084159390 2024-05-09T01:41:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f310b59e640 1 Processor -- start 2024-05-09T01:41:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fe3758bd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3700ce040 0x7fe37014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fe3758bd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe370152fe0 0x7fe37014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fe3758bd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370158c80 0x7fe370148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fe3758bd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3701595d0 con 0x7fe3700ce040 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7f2a0bfff640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04045be0 0x7f2a040d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fe3758bd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe370072c00 con 0x7fe370152fe0 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fe3758bd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe3700c9c00 con 0x7fe370158c80 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fe36e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe370152fe0 0x7fe37014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fe36e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe370152fe0 0x7fe37014fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42436/0 (socket says 172.21.15.42:42436) 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fe36e7fc640 1 -- 172.21.15.42:0/70123125 learned_addr learned my addr 172.21.15.42:0/70123125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfc2a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdf4074220 0x7fcdf4158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfc2a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf40c5330 0x7fcdf414e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfc2a1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a11d65640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a0404d1c0 0x7f2a040d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04047e00 con 0x7f2a0404d1c0 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04047430 con 0x7f2a04006cb0 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2a040470c0 con 0x7f2a04045be0 2024-05-09T01:41:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfc2a1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf4074b70 con 0x7fcdf4074220 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdf983c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf40c5330 0x7fcdf414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdf983c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf40c5330 0x7fcdf414e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42428/0 (socket says 172.21.15.42:42428) 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdf983c640 1 -- 172.21.15.42:0/1891939526 learned_addr learned my addr 172.21.15.42:0/1891939526 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfc2a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf40708d0 con 0x7fcdf40c5330 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfa03d640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdf4074220 0x7fcdf4158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.589+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf41531a0 con 0x7fcdf40c7a30 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f50837fe640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50840ce040 0x7f50841eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5082ffd640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 0x7f508414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fe36f7fe640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370158c80 0x7fe370148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5486139640 1 -- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54780471b0 msgr2=0x7f5478047730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5486139640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54780471b0 0x7f5478047730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5486139640 1 -- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 msgr2=0x7f54780c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5486139640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f547804c940 0x7f54780c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5486139640 1 -- 172.21.15.42:0/778200140 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5478171e70 con 0x7f547800e480 2024-05-09T01:41:07.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fe36effd640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3700ce040 0x7fe37014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fcdf983c640 1 -- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 msgr2=0x7fcdf414a530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:41:07.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fcdf983c640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdf40c7a30 0x7fcdf414a530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fcdf983c640 1 -- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdf4074220 msgr2=0x7fcdf4158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fcdf983c640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdf4074220 0x7fcdf4158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fcdf983c640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf40c2120 con 0x7fcdf40c5330 2024-05-09T01:41:07.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5486139640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478171930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f547c00b440 tx=0x7f547c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f771401b070 con 0x7f771c0cd5a0 2024-05-09T01:41:07.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a10d63640 1 -- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04045be0 msgr2=0x7f2a040d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f50837fe640 1 -- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5084159390 msgr2=0x7f50841536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f50837fe640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5084159390 0x7f50841536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f50837fe640 1 -- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 msgr2=0x7f508414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f50837fe640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5084152fe0 0x7f508414a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f50837fe640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50841ef320 con 0x7f50840ce040 2024-05-09T01:41:07.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5083fff640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5084159390 0x7f50841536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fcdf983c640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf40c5330 0x7fcdf414e830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00ce10 tx=0x7fcdec00a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a10d63640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a04045be0 0x7f2a040d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a10d63640 1 -- 172.21.15.42:0/1426314425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a0404d1c0 msgr2=0x7f2a040d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a10d63640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a0404d1c0 0x7f2a040d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f2a10d63640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a04166ab0 con 0x7f2a04006cb0 2024-05-09T01:41:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f6695a44640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6688007650 0x7f668817cf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f668c00b3f0 tx=0x7f668c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c015020 con 0x7f547800e480 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547c011890 con 0x7f547800e480 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c011c80 con 0x7f547800e480 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5478171430 con 0x7f547800e480 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7fe36e7fc640 1 -- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370158c80 msgr2=0x7fe370148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fe36e7fc640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe370158c80 0x7fe370148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fe36e7fc640 1 -- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3700ce040 msgr2=0x7fe37014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fe36e7fc640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3700ce040 0x7fe37014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fe36e7fc640 1 -- 172.21.15.42:0/70123125 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe370150f70 con 0x7fe370152fe0 2024-05-09T01:41:07.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f7718ff9640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f77080763a0 0x7f77080788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7714096d10 con 0x7f771c0cd5a0 2024-05-09T01:41:07.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c015020 con 0x7f6688007650 2024-05-09T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f2a10d63640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a04006cb0 0x7f2a040c46b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29f800e8a0 tx=0x7f29f800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c011830 con 0x7f6688007650 2024-05-09T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f7718ff9640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f770807e670 0x7f7708080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 --> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7714014e50 con 0x7f770807e670 2024-05-09T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7714099310 con 0x7f771c0cd5a0 2024-05-09T01:41:07.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66880e7330 con 0x7f6688007650 2024-05-09T01:41:07.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f50837fe640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50840ce040 0x7f50841eede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f507c032000 tx=0x7f507c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fe36e7fc640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe370152fe0 0x7fe37014fc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe36000c1d0 tx=0x7fe360004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66880e5960 con 0x7f6688007650 2024-05-09T01:41:07.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54780dcb40 con 0x7f547800e480 2024-05-09T01:41:07.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8017070 con 0x7f2a04006cb0 2024-05-09T01:41:07.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.590+0000 7f310b59e640 1 -- start start 2024-05-09T01:41:07.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00f680 con 0x7fcdf40c5330 2024-05-09T01:41:07.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f800c8e0 con 0x7f2a04006cb0 2024-05-09T01:41:07.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdec00f820 con 0x7fcdf40c5330 2024-05-09T01:41:07.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf4157370 con 0x7fcdf40c5330 2024-05-09T01:41:07.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c011c00 con 0x7f6688007650 2024-05-09T01:41:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.591+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a04171bb0 con 0x7f2a04006cb0 2024-05-09T01:41:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a04172170 con 0x7f2a04006cb0 2024-05-09T01:41:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf4157630 con 0x7fcdf40c5330 2024-05-09T01:41:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f310b59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104037490 0x7f31040cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00fc10 con 0x7fcdf40c5330 2024-05-09T01:41:07.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5478005570 con 0x7f547800e480 2024-05-09T01:41:07.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f771bfff640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f77080763a0 0x7f77080788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f771b7fe640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f770807e670 0x7f7708080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c035760 con 0x7f50840ce040 2024-05-09T01:41:07.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c044070 con 0x7f50840ce040 2024-05-09T01:41:07.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c035b60 con 0x7f50840ce040 2024-05-09T01:41:07.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe360041070 con 0x7fe370152fe0 2024-05-09T01:41:07.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310b59e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104050b90 0x7f3104171650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36000ae50 con 0x7fe370152fe0 2024-05-09T01:41:07.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104037490 0x7f31040cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7fe3758bd640 1 -- 172.21.15.42:0/70123125 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe370151250 con 0x7fe370152fe0 2024-05-09T01:41:07.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104037490 0x7f31040cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42438/0 (socket says 172.21.15.42:42438) 2024-05-09T01:41:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe360008490 con 0x7fe370152fe0 2024-05-09T01:41:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310a59c640 1 -- 172.21.15.42:0/3650181793 learned_addr learned my addr 172.21.15.42:0/3650181793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5084155cf0 con 0x7f50840ce040 2024-05-09T01:41:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.592+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50841ee8c0 con 0x7f50840ce040 2024-05-09T01:41:07.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7fe3758bd640 1 -- 172.21.15.42:0/70123125 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe370151810 con 0x7fe370152fe0 2024-05-09T01:41:07.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310b59e640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d9370 0x7f31040d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f3109d9b640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104050b90 0x7f3104171650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31040d9780 con 0x7f31040d9370 2024-05-09T01:41:07.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f310404a310 con 0x7f3104037490 2024-05-09T01:41:07.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3104050fa0 con 0x7f3104050b90 2024-05-09T01:41:07.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f310ad9d640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d9370 0x7f31040d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcddc001030 con 0x7fcdf40c5330 2024-05-09T01:41:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f3109d9b640 1 -- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104037490 msgr2=0x7f31040cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f3109d9b640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104037490 0x7f31040cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f3109d9b640 1 -- 172.21.15.42:0/3650181793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d9370 msgr2=0x7f31040d7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f3109d9b640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d9370 0x7f31040d7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f3109d9b640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31040cd9b0 con 0x7f3104050b90 2024-05-09T01:41:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.593+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f800ccd0 con 0x7f2a04006cb0 2024-05-09T01:41:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a040059c0 con 0x7f2a04006cb0 2024-05-09T01:41:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f3109d9b640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104050b90 0x7f3104171650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c3c0 tx=0x7f30fc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5064001030 con 0x7f50840ce040 2024-05-09T01:41:07.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe348001030 con 0x7fe370152fe0 2024-05-09T01:41:07.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc017070 con 0x7f3104050b90 2024-05-09T01:41:07.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30fc005ce0 con 0x7f3104050b90 2024-05-09T01:41:07.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f771bfff640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f77080763a0 0x7f77080788b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f770c034000 tx=0x7f770c02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3104171b90 con 0x7f3104050b90 2024-05-09T01:41:07.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3104174e80 con 0x7f3104050b90 2024-05-09T01:41:07.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc017070 con 0x7f3104050b90 2024-05-09T01:41:07.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.594+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f547c018020 con 0x7f547800e480 2024-05-09T01:41:07.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f5476ffd640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f54640763d0 0x7f54640788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f547c097630 con 0x7f547800e480 2024-05-09T01:41:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f5476ffd640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7f546407e620 0x7f5464080a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.595+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 --> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5464081140 con 0x7f546407e620 2024-05-09T01:41:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcdec003990 con 0x7fcdf40c5330 2024-05-09T01:41:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7fcdeaffd640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdd80763a0 0x7fcdd80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f548693a640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7f546407e620 0x7f5464080a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6678001030 con 0x7f6688007650 2024-05-09T01:41:07.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f668c018020 con 0x7f6688007650 2024-05-09T01:41:07.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f5485938640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f54640763d0 0x7f54640788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f771b7fe640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f770807e670 0x7f7708080ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31040dcf60 con 0x7f3104050b90 2024-05-09T01:41:07.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29f801a070 con 0x7f2a04006cb0 2024-05-09T01:41:07.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f66867fc640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f66740763a0 0x7f66740788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcdec0989d0 con 0x7fcdf40c5330 2024-05-09T01:41:07.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f547c09e050 con 0x7f547800e480 2024-05-09T01:41:07.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7fcdeaffd640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fcdd807e670 0x7fcdd8080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f668c0974a0 con 0x7f6688007650 2024-05-09T01:41:07.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f6695243640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f66740763a0 0x7f66740788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7fcdfa03d640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdd80763a0 0x7fcdd80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.596+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcdec010e50 con 0x7fcdd807e670 2024-05-09T01:41:07.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcdec098dc0 con 0x7fcdf40c5330 2024-05-09T01:41:07.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f66867fc640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f667407e670 0x7f6674080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== osd.4 v2:172.21.15.181:6800/1664109051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7714014e50 con 0x7f770807e670 2024-05-09T01:41:07.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7fcdfa83e640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fcdd807e670 0x7fcdd8080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a097fa640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f29f00763d0 0x7f29f00788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f6696245640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f667407e670 0x7f6674080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f548693a640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7f546407e620 0x7f5464080a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 --> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f668c013ec0 con 0x7f667407e670 2024-05-09T01:41:07.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a0bfff640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f29f00763d0 0x7f29f00788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29f8097240 con 0x7f2a04006cb0 2024-05-09T01:41:07.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a097fa640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f29f007e6a0 0x7f29f0080af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f8008eb0 con 0x7f29f007e6a0 2024-05-09T01:41:07.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe360044070 con 0x7fe370152fe0 2024-05-09T01:41:07.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f29f809e050 con 0x7f2a04006cb0 2024-05-09T01:41:07.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30fc01a070 con 0x7f3104050b90 2024-05-09T01:41:07.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f2a11564640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f29f007e6a0 0x7f29f0080af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7fe357fff640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe35c0763a0 0x7fe35c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f668c09e050 con 0x7f6688007650 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f6696245640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f667407e670 0x7f6674080ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.597+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f507c035d00 con 0x7f50840ce040 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f506bfff640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50700763a0 0x7f50700788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f507c0bb060 con 0x7f50840ce040 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f5082ffd640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50700763a0 0x7f50700788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f506bfff640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f507007e670 0x7f5070080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f507c049e50 con 0x7f507007e670 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f507c0bb450 con 0x7f50840ce040 2024-05-09T01:41:07.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.598+0000 7f5083fff640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f507007e670 0x7f5070080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe3600b8ab0 con 0x7fe370152fe0 2024-05-09T01:41:07.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f30faffd640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f30ec076500 0x7f30ec078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fe357fff640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7fe35c07e670 0x7fe35c080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 --> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe360031750 con 0x7fe35c07e670 2024-05-09T01:41:07.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe3600b8ea0 con 0x7fe370152fe0 2024-05-09T01:41:07.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f2a11564640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f29f007e6a0 0x7f29f0080af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f5485938640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f54640763d0 0x7f54640788e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5470045000 tx=0x7f547003f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fe36effd640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe35c0763a0 0x7fe35c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f6695243640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f66740763a0 0x7f66740788b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6688033100 tx=0x7f6680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== osd.3 v2:172.21.15.42:6800/1948174353 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5464081140 con 0x7f546407e620 2024-05-09T01:41:07.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f2a0bfff640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f29f00763d0 0x7f29f00788e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a04047dd0 tx=0x7f2a00006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f5083fff640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f507007e670 0x7f5070080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f30fc0963a0 con 0x7f3104050b90 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f30faffd640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7f30ec07e750 0x7f30ec080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30ec081270 con 0x7f30ec07e750 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f310a59c640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f30ec076500 0x7f30ec078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30fc09d050 con 0x7f3104050b90 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f310ad9d640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7f30ec07e750 0x7f30ec080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fcdfa03d640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdd80763a0 0x7fcdd80788b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0001220 tx=0x7fcdf0001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fcdfa83e640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fcdd807e670 0x7fcdd8080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7f5082ffd640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50700763a0 0x7f50700788b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5078007fd0 tx=0x7f5078009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.599+0000 7fe36f7fe640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7fe35c07e670 0x7fe35c080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== osd.2 v2:172.21.15.42:6824/1807965313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f668c013ec0 con 0x7f667407e670 2024-05-09T01:41:07.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7f310a59c640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f30ec076500 0x7f30ec078a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f310c06ba40 tx=0x7f310c0b5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7fe36effd640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe35c0763a0 0x7fe35c0788b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe368006fd0 tx=0x7fe368008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7f310ad9d640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7f30ec07e750 0x7f30ec080ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== osd.5 v2:172.21.15.181:6824/3826879065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29f8008eb0 con 0x7f29f007e6a0 2024-05-09T01:41:07.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== osd.0 v2:172.21.15.42:6808/1460216605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcdec010e50 con 0x7fcdd807e670 2024-05-09T01:41:07.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7fe36f7fe640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7fe35c07e670 0x7fe35c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.600+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== osd.6 v2:172.21.15.181:6816/727737785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f507c049e50 con 0x7f507007e670 2024-05-09T01:41:07.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.602+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== osd.1 v2:172.21.15.42:6814/1456443554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe360031750 con 0x7fe35c07e670 2024-05-09T01:41:07.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.602+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== osd.7 v2:172.21.15.181:6808/3827658741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30ec081270 con 0x7f30ec07e750 2024-05-09T01:41:07.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.629+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 --> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5064002dd0 con 0x7f507007e670 2024-05-09T01:41:07.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.629+0000 7f506bfff640 1 -- 172.21.15.42:0/303321761 <== osd.6 v2:172.21.15.181:6816/727737785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5064002dd0 con 0x7f507007e670 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f507007e670 msgr2=0x7f5070080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f507007e670 0x7f5070080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50700763a0 msgr2=0x7f50700788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50700763a0 0x7f50700788b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5078007fd0 tx=0x7f5078009040 comp rx=0 tx=0).stop 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50840ce040 msgr2=0x7f50841eede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 --2- 172.21.15.42:0/303321761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50840ce040 0x7f50841eede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f507c032000 tx=0x7f507c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f5083fff640 1 -- 172.21.15.42:0/303321761 reap_dead start 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 shutdown_connections 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.630+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 >> 172.21.15.42:0/303321761 conn(0x7f508406c850 msgr2=0x7f50840cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.631+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 shutdown_connections 2024-05-09T01:41:07.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.631+0000 7f77211ea640 1 -- 172.21.15.42:0/807719200 --> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f771c164420 con 0x7f770807e670 2024-05-09T01:41:07.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.631+0000 7f508a0b8640 1 -- 172.21.15.42:0/303321761 wait complete. 2024-05-09T01:41:07.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.632+0000 7f7718ff9640 1 -- 172.21.15.42:0/807719200 <== osd.4 v2:172.21.15.181:6800/1664109051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f771c164420 con 0x7f770807e670 2024-05-09T01:41:07.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 --> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54780dd470 con 0x7f546407e620 2024-05-09T01:41:07.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f770807e670 msgr2=0x7f7708080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77027fc640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f770807e670 0x7f7708080ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f77080763a0 msgr2=0x7f77080788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77027fc640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f77080763a0 0x7f77080788b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f770c034000 tx=0x7f770c02c000 comp rx=0 tx=0).stop 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f771c0cd5a0 msgr2=0x7f771c0c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77027fc640 1 --2- 172.21.15.42:0/807719200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f771c0cd5a0 0x7f771c0c6a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f771400c870 tx=0x7f771400cd30 comp rx=0 tx=0).stop 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f77209e9640 1 -- 172.21.15.42:0/807719200 reap_dead start 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.633+0000 7f5476ffd640 1 -- 172.21.15.42:0/778200140 <== osd.3 v2:172.21.15.42:6800/1948174353 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f54780dd470 con 0x7f546407e620 2024-05-09T01:41:07.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 shutdown_connections 2024-05-09T01:41:07.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 >> 172.21.15.42:0/807719200 conn(0x7f771c06ca90 msgr2=0x7f771c072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 --> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a04007e00 con 0x7f29f007e6a0 2024-05-09T01:41:07.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 --> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6678002d50 con 0x7f667407e670 2024-05-09T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 shutdown_connections 2024-05-09T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f77027fc640 1 -- 172.21.15.42:0/807719200 wait complete. 2024-05-09T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7f546407e620 msgr2=0x7f5464080a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.634+0000 7f548713b640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7f546407e620 0x7f5464080a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f54640763d0 msgr2=0x7f54640788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a097fa640 1 -- 172.21.15.42:0/1426314425 <== osd.5 v2:172.21.15.181:6824/3826879065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a04007e00 con 0x7f29f007e6a0 2024-05-09T01:41:07.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f54640763d0 0x7f54640788e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5470045000 tx=0x7f547003f000 comp rx=0 tx=0).stop 2024-05-09T01:41:07.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f66867fc640 1 -- 172.21.15.42:0/3948175149 <== osd.2 v2:172.21.15.42:6824/1807965313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6678002d50 con 0x7f667407e670 2024-05-09T01:41:07.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 --> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcddc002dd0 con 0x7fcdd807e670 2024-05-09T01:41:07.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 msgr2=0x7f5478171930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 --2- 172.21.15.42:0/778200140 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f547800e480 0x7f5478171930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f547c00b440 tx=0x7f547c00b900 comp rx=0 tx=0).stop 2024-05-09T01:41:07.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548693a640 1 -- 172.21.15.42:0/778200140 reap_dead start 2024-05-09T01:41:07.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 shutdown_connections 2024-05-09T01:41:07.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 >> 172.21.15.42:0/778200140 conn(0x7f54780503b0 msgr2=0x7f54780072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 --> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe348002dd0 con 0x7fe35c07e670 2024-05-09T01:41:07.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f29f007e6a0 msgr2=0x7f29f0080af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a11d65640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f29f007e6a0 0x7f29f0080af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 shutdown_connections 2024-05-09T01:41:07.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f548713b640 1 -- 172.21.15.42:0/778200140 wait complete. 2024-05-09T01:41:07.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f29f00763d0 msgr2=0x7f29f00788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a11d65640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f29f00763d0 0x7f29f00788e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a04047dd0 tx=0x7f2a00006aa0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f667407e670 msgr2=0x7f6674080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a04006cb0 msgr2=0x7f2a040c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f2a11d65640 1 --2- 172.21.15.42:0/1426314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a04006cb0 0x7f2a040c46b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29f800e8a0 tx=0x7f29f800ed60 comp rx=0 tx=0).stop 2024-05-09T01:41:07.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7fcdeaffd640 1 -- 172.21.15.42:0/1891939526 <== osd.0 v2:172.21.15.42:6808/1460216605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcddc002dd0 con 0x7fcdd807e670 2024-05-09T01:41:07.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.635+0000 7f6697ca8640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f667407e670 0x7f6674080ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f2a11564640 1 -- 172.21.15.42:0/1426314425 reap_dead start 2024-05-09T01:41:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fe357fff640 1 -- 172.21.15.42:0/70123125 <== osd.1 v2:172.21.15.42:6814/1456443554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe348002dd0 con 0x7fe35c07e670 2024-05-09T01:41:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 shutdown_connections 2024-05-09T01:41:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 >> 172.21.15.42:0/1426314425 conn(0x7f2a04050c40 msgr2=0x7f2a04007150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f66740763a0 msgr2=0x7f66740788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f66740763a0 0x7f66740788b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6688033100 tx=0x7f6680009040 comp rx=0 tx=0).stop 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6688007650 msgr2=0x7f668817cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 --2- 172.21.15.42:0/3948175149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6688007650 0x7f668817cf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f668c00b3f0 tx=0x7f668c00b8b0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6696245640 1 -- 172.21.15.42:0/3948175149 reap_dead start 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fcdd807e670 msgr2=0x7fcdd8080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fcdd807e670 0x7fcdd8080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 --> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3104174950 con 0x7f30ec07e750 2024-05-09T01:41:07.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 shutdown_connections 2024-05-09T01:41:07.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 >> 172.21.15.42:0/3948175149 conn(0x7f66880503e0 msgr2=0x7f668804d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdd80763a0 msgr2=0x7fcdd80788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdd80763a0 0x7fcdd80788b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0001220 tx=0x7fcdf0001630 comp rx=0 tx=0).stop 2024-05-09T01:41:07.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf40c5330 msgr2=0x7fcdf414e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 --2- 172.21.15.42:0/1891939526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf40c5330 0x7fcdf414e830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00ce10 tx=0x7fcdec00a650 comp rx=0 tx=0).stop 2024-05-09T01:41:07.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 shutdown_connections 2024-05-09T01:41:07.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 shutdown_connections 2024-05-09T01:41:07.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfa83e640 1 -- 172.21.15.42:0/1891939526 reap_dead start 2024-05-09T01:41:07.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7fe35c07e670 msgr2=0x7fe35c080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f6697ca8640 1 -- 172.21.15.42:0/3948175149 wait complete. 2024-05-09T01:41:07.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7f2a11d65640 1 -- 172.21.15.42:0/1426314425 wait complete. 2024-05-09T01:41:07.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 shutdown_connections 2024-05-09T01:41:07.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 >> 172.21.15.42:0/1891939526 conn(0x7fcdf406cdc0 msgr2=0x7fcdf4150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.636+0000 7fe34ffff640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7fe35c07e670 0x7fe35c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 shutdown_connections 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe35c0763a0 msgr2=0x7fe35c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe35c0763a0 0x7fe35c0788b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe368006fd0 tx=0x7fe368008040 comp rx=0 tx=0).stop 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe370152fe0 msgr2=0x7fe37014fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 --2- 172.21.15.42:0/70123125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe370152fe0 0x7fe37014fc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe36000c1d0 tx=0x7fe360004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe36f7fe640 1 -- 172.21.15.42:0/70123125 reap_dead start 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fcdfc2a1640 1 -- 172.21.15.42:0/1891939526 wait complete. 2024-05-09T01:41:07.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 shutdown_connections 2024-05-09T01:41:07.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 >> 172.21.15.42:0/70123125 conn(0x7fe37006c850 msgr2=0x7fe370073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7f30faffd640 1 -- 172.21.15.42:0/3650181793 <== osd.7 v2:172.21.15.181:6808/3827658741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3104174950 con 0x7f30ec07e750 2024-05-09T01:41:07.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 shutdown_connections 2024-05-09T01:41:07.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.637+0000 7fe34ffff640 1 -- 172.21.15.42:0/70123125 wait complete. 2024-05-09T01:41:07.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7f30ec07e750 msgr2=0x7f30ec080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310b59e640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7f30ec07e750 0x7f30ec080ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f30ec076500 msgr2=0x7f30ec078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310b59e640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f30ec076500 0x7f30ec078a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f310c06ba40 tx=0x7f310c0b5000 comp rx=0 tx=0).stop 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104050b90 msgr2=0x7f3104171650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310b59e640 1 --2- 172.21.15.42:0/3650181793 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3104050b90 0x7f3104171650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c3c0 tx=0x7f30fc00c880 comp rx=0 tx=0).stop 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.638+0000 7f310ad9d640 1 -- 172.21.15.42:0/3650181793 reap_dead start 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.639+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 shutdown_connections 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.639+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 >> 172.21.15.42:0/3650181793 conn(0x7f31040547b0 msgr2=0x7f31040d6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.639+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 shutdown_connections 2024-05-09T01:41:07.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.640+0000 7f310b59e640 1 -- 172.21.15.42:0/3650181793 wait complete. 2024-05-09T01:41:07.694 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-05-09T01:41:07.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T01:41:07.695 INFO:teuthology.orchestra.run.smithi042.stdout:55834574855 2024-05-09T01:41:07.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T01:41:07.696 INFO:teuthology.orchestra.run.smithi042.stdout:60129542151 2024-05-09T01:41:07.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T01:41:07.697 INFO:teuthology.orchestra.run.smithi042.stdout:60129542151 2024-05-09T01:41:07.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T01:41:07.698 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-05-09T01:41:07.698 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T01:41:07.699 INFO:teuthology.orchestra.run.smithi042.stdout:60129542152 2024-05-09T01:41:07.699 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T01:41:07.700 INFO:teuthology.orchestra.run.smithi042.stdout:60129542153 2024-05-09T01:41:07.700 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-05-09T01:41:07.701 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T01:41:07.701 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T01:41:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.968+0000 7f91d759e640 1 Processor -- start 2024-05-09T01:41:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.968+0000 7f91d759e640 1 -- start start 2024-05-09T01:41:07.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d759e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d0006a90 0x7f91d0045e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d759e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f91d00d56f0 0x7f91d004c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7fa48e056640 1 Processor -- start 2024-05-09T01:41:07.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7fa48e056640 1 -- start start 2024-05-09T01:41:07.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f5629b1b640 1 Processor -- start 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7f5629b1b640 1 -- start start 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d759e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d0047540 con 0x7f91d00334e0 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d759e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f91d0034fe0 con 0x7f91d00d56f0 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d759e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f91d0035840 con 0x7f91d0006a90 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f91d00334e0 0x7f91d0046d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42832/0 (socket says 172.21.15.42:42832) 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d659c640 1 -- 172.21.15.42:0/1884682792 learned_addr learned my addr 172.21.15.42:0/1884682792 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f91d5d9b640 1 --2- 172.21.15.42:0/1884682792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d0006a90 0x7f91d0045e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7f91d6d9d640 1 --2- 172.21.15.42:0/1884682792 >> v2:172.21.15.42:3300/0 conn(0x7f91d00d56f0 0x7f91d004c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7f91d5d9b640 1 -- 172.21.15.42:0/1884682792 >> v2:172.21.15.42:3300/0 conn(0x7f91d00d56f0 msgr2=0x7f91d004c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7f91d5d9b640 1 --2- 172.21.15.42:0/1884682792 >> v2:172.21.15.42:3300/0 conn(0x7f91d00d56f0 0x7f91d004c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7f91d5d9b640 1 -- 172.21.15.42:0/1884682792 >> v1:172.21.15.181:6789/0 conn(0x7f91d00334e0 legacy=0x7f91d0046d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7f91d5d9b640 1 -- 172.21.15.42:0/1884682792 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d0035280 con 0x7f91d0006a90 2024-05-09T01:41:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.972+0000 7fb2c1746640 1 Processor -- start 2024-05-09T01:41:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.973+0000 7f91d5d9b640 1 --2- 172.21.15.42:0/1884682792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d0006a90 0x7f91d0045e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91c80097a0 tx=0x7f91c8029f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b053fbb9f2314b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.973+0000 7fb2c1746640 1 -- start start 2024-05-09T01:41:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.973+0000 7f91d559a640 1 -- 172.21.15.42:0/1884682792 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8037070 con 0x7f91d0006a90 2024-05-09T01:41:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.973+0000 7f91d559a640 1 -- 172.21.15.42:0/1884682792 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c802ac60 con 0x7f91d0006a90 2024-05-09T01:41:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f3c98d73640 1 Processor -- start 2024-05-09T01:41:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.971+0000 7f3c98d73640 1 -- start start 2024-05-09T01:41:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48e056640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa48004cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48e056640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800dc470 con 0x7fa4800464e0 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48d054640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa4800464e0 0x7fa4800d61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50308/0 (socket says 172.21.15.42:50308) 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48d054640 1 -- 172.21.15.42:0/2260220517 learned_addr learned my addr 172.21.15.42:0/2260220517 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa480046f30 con 0x7fa4800483e0 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa480047210 con 0x7fa480047fd0 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f5629b1b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f561c0e41b0 0x7f561c007c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f5629b1b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f561c008160 0x7f561c0ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f5629b1b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561c04b740 con 0x7f561c006c70 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f5629b1b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f561c04ced0 con 0x7f561c0e41b0 2024-05-09T01:41:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f5629b1b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f561c0e45c0 con 0x7f561c008160 2024-05-09T01:41:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f3c98d73640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94073390 0x7f3c94176a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f3c98d73640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c941640d0 con 0x7f3c9408e370 2024-05-09T01:41:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f3c98d73640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9416db70 con 0x7f3c940c9850 2024-05-09T01:41:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7efcb67c7640 1 Processor -- start 2024-05-09T01:41:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f3c98d73640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9416de50 con 0x7f3c94073390 2024-05-09T01:41:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f3c92ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3c940c9850 0x7f3c94172240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42836/0 (socket says 172.21.15.42:42836) 2024-05-09T01:41:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f3c92ffd640 1 -- 172.21.15.42:0/2840011417 learned_addr learned my addr 172.21.15.42:0/2840011417 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7efcb67c7640 1 -- start start 2024-05-09T01:41:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7fa48c853640 1 --2- 172.21.15.42:0/2260220517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa48004cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f562931a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f561c008160 0x7f561c0ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f562931a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f561c008160 0x7f561c0ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60450/0 (socket says 172.21.15.42:60450) 2024-05-09T01:41:07.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f562931a640 1 -- 172.21.15.42:0/1231180966 learned_addr learned my addr 172.21.15.42:0/1231180966 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f5623fff640 1 --2- 172.21.15.42:0/1231180966 >> v2:172.21.15.42:3300/0 conn(0x7f561c0e41b0 0x7f561c007c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fa47ffff640 1 -- 172.21.15.42:0/2260220517 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379964865 0 0) 0x7fa4800dc470 con 0x7fa4800464e0 2024-05-09T01:41:07.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.974+0000 7f91d559a640 1 -- 172.21.15.42:0/1884682792 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8032660 con 0x7f91d0006a90 2024-05-09T01:41:07.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fa47ffff640 1 -- 172.21.15.42:0/2260220517 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa474003520 con 0x7fa4800464e0 2024-05-09T01:41:07.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f91d759e640 1 -- 172.21.15.42:0/1884682792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d0006a90 msgr2=0x7f91d0045e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f91d759e640 1 --2- 172.21.15.42:0/1884682792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d0006a90 0x7f91d0045e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91c80097a0 tx=0x7f91c8029f90 comp rx=0 tx=0).stop 2024-05-09T01:41:07.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fa48c853640 1 -- 172.21.15.42:0/2260220517 >> v1:172.21.15.181:6789/0 conn(0x7fa4800483e0 legacy=0x7fa4800e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fa48c853640 1 -- 172.21.15.42:0/2260220517 >> v1:172.21.15.42:6789/0 conn(0x7fa4800464e0 legacy=0x7fa4800d61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f91d759e640 1 -- 172.21.15.42:0/1884682792 shutdown_connections 2024-05-09T01:41:07.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f91d759e640 1 --2- 172.21.15.42:0/1884682792 >> v2:172.21.15.42:3300/0 conn(0x7f91d00d56f0 0x7f91d004c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f91d759e640 1 --2- 172.21.15.42:0/1884682792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d0006a90 0x7f91d0045e70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f91d759e640 1 -- 172.21.15.42:0/1884682792 >> 172.21.15.42:0/1884682792 conn(0x7f91d00503b0 msgr2=0x7f91d00507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f5623fff640 1 -- 172.21.15.42:0/1231180966 >> v2:172.21.15.181:3300/0 conn(0x7f561c008160 msgr2=0x7f561c0ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fa48c853640 1 -- 172.21.15.42:0/2260220517 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4800474f0 con 0x7fa480047fd0 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f5623fff640 1 --2- 172.21.15.42:0/1231180966 >> v2:172.21.15.181:3300/0 conn(0x7f561c008160 0x7f561c0ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f5623fff640 1 -- 172.21.15.42:0/1231180966 >> v1:172.21.15.42:6789/0 conn(0x7f561c006c70 legacy=0x7f561c04c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f5623fff640 1 -- 172.21.15.42:0/1231180966 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c04ba00 con 0x7f561c0e41b0 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641077013 0 0) 0x7f3c941640d0 con 0x7f3c9408e370 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c80003520 con 0x7f3c9408e370 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c93fff640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94073390 0x7f3c94176a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2625177072 0 0) 0x7f3c80003520 con 0x7f3c9408e370 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94073390 msgr2=0x7f3c94176a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94073390 0x7f3c94176a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 >> v1:172.21.15.181:6789/0 conn(0x7f3c940c9850 legacy=0x7f3c94172240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c940c8730 con 0x7f3c9408e370 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f3c7c0016f0 con 0x7f3c9408e370 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f91d759e640 1 -- 172.21.15.42:0/1884682792 shutdown_connections 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fb2c1746640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb2bc0c9790 0x7fb2bc0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fb2c1746640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc16be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fb2bbfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb2bc073390 0x7fb2bc06fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50330/0 (socket says 172.21.15.42:50330) 2024-05-09T01:41:07.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fb2bbfff640 1 -- 172.21.15.42:0/2894765210 learned_addr learned my addr 172.21.15.42:0/2894765210 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.975+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc161490 con 0x7fb2bc073390 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc0c6310 con 0x7fb2bc0c9790 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc0c9300 con 0x7fb2bc169a50 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7fb2bb7fe640 1 --2- 172.21.15.42:0/2894765210 >> v2:172.21.15.181:3300/0 conn(0x7fb2bc0c9790 0x7fb2bc0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7fb2c0f45640 1 --2- 172.21.15.42:0/2894765210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc16be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7fb2baffd640 1 -- 172.21.15.42:0/2894765210 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151168396 0 0) 0x7fb2bc161490 con 0x7fb2bc073390 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7fb2baffd640 1 -- 172.21.15.42:0/2894765210 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a4003520 con 0x7fb2bc073390 2024-05-09T01:41:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f91d759e640 1 -- 172.21.15.42:0/1884682792 wait complete. 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 >> v1:172.21.15.42:6789/0 conn(0x7f3c9408e370 legacy=0x7f3c9406fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c80003a30 0x7f3c80003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c80004800 0x7f3c80004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c80005270 0x7f3c800141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9416de50 con 0x7f3c80003a30 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c800149c0 con 0x7f3c80005270 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.976+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3c80014bc0 con 0x7f3c80004800 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c80004800 0x7f3c80004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb67c7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efca8035050 0x7efca8006090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fa48c853640 1 --2- 172.21.15.42:0/2260220517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa48004cd20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa4780097d0 tx=0x7fa47802a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c567cd332e2176c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb67c7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca804b5d0 con 0x7efca80d7430 2024-05-09T01:41:07.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb67c7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca804b8b0 con 0x7efca80e0ee0 2024-05-09T01:41:07.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb67c7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7efca8036420 con 0x7efca8035050 2024-05-09T01:41:07.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb5fc6640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7efca80e0ee0 0x7efca80e7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42854/0 (socket says 172.21.15.42:42854) 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb5fc6640 1 -- 172.21.15.42:0/1450175087 learned_addr learned my addr 172.21.15.42:0/1450175087 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c93fff640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c80005270 0x7f3c800141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c937fe640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c80003a30 0x7f3c80003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c92ffd640 1 -- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c80005270 msgr2=0x7f3c800141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c80005270 0x7f3c800141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c92ffd640 1 -- 172.21.15.42:0/2840011417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c80003a30 msgr2=0x7f3c80003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c80003a30 0x7f3c80003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f3c92ffd640 1 -- 172.21.15.42:0/2840011417 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c940c8730 con 0x7f3c80004800 2024-05-09T01:41:07.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fecfcd4d640 1 Processor -- start 2024-05-09T01:41:07.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fecfcd4d640 1 -- start start 2024-05-09T01:41:07.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f267c5cf640 1 Processor -- start 2024-05-09T01:41:07.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7f5623fff640 1 --2- 172.21.15.42:0/1231180966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 0x7f561c007c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f561c04b230 tx=0x7f561002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4fbd07e8ca2624 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fa47ffff640 1 -- 172.21.15.42:0/2260220517 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478037070 con 0x7fa480047fd0 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7fa47ffff640 1 -- 172.21.15.42:0/2260220517 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47802ae20 con 0x7fa480047fd0 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7fa47ffff640 1 -- 172.21.15.42:0/2260220517 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478032660 con 0x7fa480047fd0 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fb2c0f45640 1 -- 172.21.15.42:0/2894765210 >> v2:172.21.15.181:3300/0 conn(0x7fb2bc0c9790 msgr2=0x7fb2bc0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fb2c0f45640 1 --2- 172.21.15.42:0/2894765210 >> v2:172.21.15.181:3300/0 conn(0x7fb2bc0c9790 0x7fb2bc0c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fb2c0f45640 1 -- 172.21.15.42:0/2894765210 >> v1:172.21.15.42:6789/0 conn(0x7fb2bc073390 legacy=0x7fb2bc06fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7fb2c0f45640 1 -- 172.21.15.42:0/2894765210 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0c8730 con 0x7fb2bc169a50 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7f267c5cf640 1 -- start start 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7f56237fe640 1 -- 172.21.15.42:0/1231180966 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610037070 con 0x7f561c0e41b0 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7f56237fe640 1 -- 172.21.15.42:0/1231180966 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5610032440 con 0x7f561c0e41b0 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7fb2c0f45640 1 --2- 172.21.15.42:0/2894765210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc16be70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009d90 tx=0x7fb2b402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9fd879fdfb5e3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7fb2baffd640 1 -- 172.21.15.42:0/2894765210 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4007740 con 0x7fb2bc169a50 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7fb2baffd640 1 -- 172.21.15.42:0/2894765210 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b40078e0 con 0x7fb2bc169a50 2024-05-09T01:41:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7fb2baffd640 1 -- 172.21.15.42:0/2894765210 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4007cb0 con 0x7fb2bc169a50 2024-05-09T01:41:07.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.977+0000 7efcb57c5640 1 --2- 172.21.15.42:0/1450175087 >> v2:172.21.15.181:3300/0 conn(0x7efca8035050 0x7efca8006090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382948855 0 0) 0x7efca804b5d0 con 0x7efca80d7430 2024-05-09T01:41:07.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc9c003520 con 0x7efca80d7430 2024-05-09T01:41:07.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326728611 0 0) 0x7efca804b8b0 con 0x7efca80e0ee0 2024-05-09T01:41:07.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc9c0048e0 con 0x7efca80e0ee0 2024-05-09T01:41:07.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c80004800 0x7f3c80004c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400c160 tx=0x7f3c80005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfde798f6e86f7b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:07.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7f56237fe640 1 -- 172.21.15.42:0/1231180966 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610032810 con 0x7f561c0e41b0 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1691318148 0 0) 0x7efc9c003520 con 0x7efca80d7430 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 >> v2:172.21.15.181:3300/0 conn(0x7efca8035050 msgr2=0x7efca8006090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 --2- 172.21.15.42:0/1450175087 >> v2:172.21.15.181:3300/0 conn(0x7efca8035050 0x7efca8006090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 >> v1:172.21.15.181:6789/0 conn(0x7efca80e0ee0 legacy=0x7efca80e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca8034570 con 0x7efca80d7430 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.978+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7efcb006a500 con 0x7efca80d7430 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84001f20 con 0x7f3c80004800 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c84032630 con 0x7f3c80004800 2024-05-09T01:41:07.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7f3c927fc640 1 -- 172.21.15.42:0/2840011417 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84032a60 con 0x7f3c80004800 2024-05-09T01:41:07.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 >> v1:172.21.15.42:6789/0 conn(0x7efca80d7430 legacy=0x7efca80e07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9c004d90 0x7efc9c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c0037a0 0x7efc9c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc9c004130 0x7efc9c0145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efca8036420 con 0x7efc9c0037a0 2024-05-09T01:41:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 msgr2=0x7fa48004cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fa48e056640 1 --2- 172.21.15.42:0/2260220517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa48004cd20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa4780097d0 tx=0x7fa47802a0d0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c014b90 con 0x7efc9c004d90 2024-05-09T01:41:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c014d60 con 0x7efc9c004130 2024-05-09T01:41:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fecfcd4d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fecf81599a0 0x7fecf80ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 shutdown_connections 2024-05-09T01:41:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7f5629b1b640 1 -- 172.21.15.42:0/1231180966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 msgr2=0x7f561c007c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:07.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fa48e056640 1 --2- 172.21.15.42:0/2260220517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa48004cd20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1231180966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 0x7f561c007c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f561c04b230 tx=0x7f561002a230 comp rx=0 tx=0).stop 2024-05-09T01:41:07.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 >> 172.21.15.42:0/2260220517 conn(0x7fa480051540 msgr2=0x7fa480051950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:07.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7f91d759e640 1 Processor -- start 2024-05-09T01:41:07.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efcb57c5640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9c004d90 0x7efc9c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f91d759e640 1 -- start start 2024-05-09T01:41:07.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efcb5fc6640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc9c004130 0x7efc9c0145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7efcb4fc4640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c0037a0 0x7efc9c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb5fc6640 1 -- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9c004d90 msgr2=0x7efc9c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fecfcd4d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fecf8068a20 0x7fecf80c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fecfcd4d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf80701f0 con 0x7fecf8068610 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fecfcd4d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fecf80cadd0 con 0x7fecf81599a0 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.979+0000 7fecfcd4d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fecf80cd520 con 0x7fecf8068a20 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7fecf6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fecf8068a20 0x7fecf80c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:07.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7fecf6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fecf8068a20 0x7fecf80c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60488/0 (socket says 172.21.15.42:60488) 2024-05-09T01:41:07.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7fecf6d9d640 1 -- 172.21.15.42:0/2198490831 learned_addr learned my addr 172.21.15.42:0/2198490831 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:07.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 shutdown_connections 2024-05-09T01:41:07.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb5fc6640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9c004d90 0x7efc9c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb5fc6640 1 -- 172.21.15.42:0/1450175087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c0037a0 msgr2=0x7efc9c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:07.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb5fc6640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c0037a0 0x7efc9c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:07.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb5fc6640 1 -- 172.21.15.42:0/1450175087 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca8034570 con 0x7efc9c004130 2024-05-09T01:41:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7fa48e056640 1 -- 172.21.15.42:0/2260220517 wait complete. 2024-05-09T01:41:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7fecf6d9d640 1 -- 172.21.15.42:0/2198490831 >> v2:172.21.15.42:3300/0 conn(0x7fecf81599a0 msgr2=0x7fecf80ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f5629b1b640 1 -- 172.21.15.42:0/1231180966 shutdown_connections 2024-05-09T01:41:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1231180966 >> v2:172.21.15.181:3300/0 conn(0x7f561c008160 0x7f561c0ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1231180966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 0x7f561c007c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f5629b1b640 1 -- 172.21.15.42:0/1231180966 >> 172.21.15.42:0/1231180966 conn(0x7f561c050c40 msgr2=0x7f561c051050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c98d73640 1 -- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c80004800 msgr2=0x7f3c80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c98d73640 1 --2- 172.21.15.42:0/2840011417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c80004800 0x7f3c80004c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400c160 tx=0x7f3c80005830 comp rx=0 tx=0).stop 2024-05-09T01:41:08.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c93fff640 1 -- 172.21.15.42:0/2840011417 reap_dead start 2024-05-09T01:41:08.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f5629b1b640 1 -- 172.21.15.42:0/1231180966 shutdown_connections 2024-05-09T01:41:08.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb4fc4640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c0037a0 0x7efc9c003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267c5cf640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f267415b620 0x7f2674161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267c5cf640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2674073790 0x7f26740707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267c5cf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2674070d10 con 0x7f2674073380 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267c5cf640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f26740c88b0 con 0x7f2674073790 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267c5cf640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f26740c8b90 con 0x7f267415b620 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267ab6c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2674073790 0x7f26740707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267ab6c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2674073790 0x7f26740707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60504/0 (socket says 172.21.15.42:60504) 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267ab6c640 1 -- 172.21.15.42:0/3113864346 learned_addr learned my addr 172.21.15.42:0/3113864346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f267a36b640 1 --2- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f267415b620 0x7f2674161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f5629b1b640 1 -- 172.21.15.42:0/1231180966 wait complete. 2024-05-09T01:41:08.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7efcb57c5640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9c004d90 0x7efc9c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:08.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7f267ab6c640 1 -- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f267415b620 msgr2=0x7f2674161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:08.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7f267ab6c640 1 --2- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f267415b620 0x7f2674161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7f267ab6c640 1 -- 172.21.15.42:0/3113864346 >> v1:172.21.15.181:6789/0 conn(0x7f2674073380 legacy=0x7f26740700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:08.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7f267ab6c640 1 -- 172.21.15.42:0/3113864346 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26740c8e70 con 0x7f2674073790 2024-05-09T01:41:08.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fecf659c640 1 --2- 172.21.15.42:0/2198490831 >> v2:172.21.15.42:3300/0 conn(0x7fecf81599a0 0x7fecf80ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7efcb5fc6640 1 -- 172.21.15.42:0/1450175087 reap_dead start 2024-05-09T01:41:08.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 msgr2=0x7fb2bc16be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fb2c1746640 1 --2- 172.21.15.42:0/2894765210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc16be70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009d90 tx=0x7fb2b402a660 comp rx=0 tx=0).stop 2024-05-09T01:41:08.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c98d73640 1 -- 172.21.15.42:0/2840011417 shutdown_connections 2024-05-09T01:41:08.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fecf6d9d640 1 --2- 172.21.15.42:0/2198490831 >> v2:172.21.15.42:3300/0 conn(0x7fecf81599a0 0x7fecf80ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fecf6d9d640 1 -- 172.21.15.42:0/2198490831 >> v1:172.21.15.181:6789/0 conn(0x7fecf8068610 legacy=0x7fecf806cd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:41:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fecf6d9d640 1 -- 172.21.15.42:0/2198490831 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf814fe10 con 0x7fecf8068a20 2024-05-09T01:41:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c98d73640 1 -- 172.21.15.42:0/2840011417 >> 172.21.15.42:0/2840011417 conn(0x7f3c9406d100 msgr2=0x7f3c940cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7fecf659c640 1 --2- 172.21.15.42:0/2198490831 >> v2:172.21.15.42:3300/0 conn(0x7fecf81599a0 0x7fecf80ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:08.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c98d73640 1 -- 172.21.15.42:0/2840011417 shutdown_connections 2024-05-09T01:41:08.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.980+0000 7f3c98d73640 1 -- 172.21.15.42:0/2840011417 wait complete. 2024-05-09T01:41:08.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.981+0000 7efcb5fc6640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc9c004130 0x7efc9c0145c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efca8009760 tx=0x7efc9c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47aa64e568e3eaf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 shutdown_connections 2024-05-09T01:41:08.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fb2c1746640 1 --2- 172.21.15.42:0/2894765210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc16be70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fb2c1746640 1 --2- 172.21.15.42:0/2894765210 >> v2:172.21.15.181:3300/0 conn(0x7fb2bc0c9790 0x7fb2bc0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f91d759e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 0x7f91d0186260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 >> 172.21.15.42:0/2894765210 conn(0x7fb2bc06d100 msgr2=0x7fb2bc0cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 shutdown_connections 2024-05-09T01:41:08.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fb2c1746640 1 -- 172.21.15.42:0/2894765210 wait complete. 2024-05-09T01:41:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f267ab6c640 1 --2- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740707d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f266c009e50 tx=0x7f266c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f486407e61d32d06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7fecf6d9d640 1 --2- 172.21.15.42:0/2198490831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068a20 0x7fecf80c48d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecf80cd810 tx=0x7fecf002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd648cadd344e48 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f2679369640 1 -- 172.21.15.42:0/3113864346 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c036070 con 0x7f2674073790 2024-05-09T01:41:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f2679369640 1 -- 172.21.15.42:0/3113864346 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c031600 con 0x7f2674073790 2024-05-09T01:41:08.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f91d659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 0x7f91d0186260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f91d659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 0x7f91d0186260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35514/0 (socket says 172.21.15.42:35514) 2024-05-09T01:41:08.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d659c640 1 -- 172.21.15.42:0/38179741 learned_addr learned my addr 172.21.15.42:0/38179741 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7f2679369640 1 -- 172.21.15.42:0/3113864346 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c0319d0 con 0x7f2674073790 2024-05-09T01:41:08.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00334e0 0x7f91d004ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7fecf559a640 1 -- 172.21.15.42:0/2198490831 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0036070 con 0x7fecf8068a20 2024-05-09T01:41:08.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7fecf559a640 1 -- 172.21.15.42:0/2198490831 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0031600 con 0x7fecf8068a20 2024-05-09T01:41:08.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7fecf559a640 1 -- 172.21.15.42:0/2198490831 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0036070 con 0x7fecf8068a20 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00d56f0 0x7f91d00d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac00a570 con 0x7efc9c004130 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca002e070 con 0x7efc9c004130 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.982+0000 7efca7fff640 1 -- 172.21.15.42:0/1450175087 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0001650 con 0x7efc9c004130 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 -- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc9c004130 msgr2=0x7efc9c0145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc9c004130 0x7efc9c0145c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efca8009760 tx=0x7efc9c005830 comp rx=0 tx=0).stop 2024-05-09T01:41:08.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f3c98d73640 1 Processor -- start 2024-05-09T01:41:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7fa48e056640 1 Processor -- start 2024-05-09T01:41:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d5d9b640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00334e0 0x7f91d004ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 -- 172.21.15.42:0/1450175087 shutdown_connections 2024-05-09T01:41:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 --2- 172.21.15.42:0/1450175087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc9c004130 0x7efc9c0145c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 -- 172.21.15.42:0/1450175087 >> 172.21.15.42:0/1450175087 conn(0x7efca80503b0 msgr2=0x7efca80507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7fa48e056640 1 -- start start 2024-05-09T01:41:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d6d9d640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00d56f0 0x7f91d00d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f3c98d73640 1 -- start start 2024-05-09T01:41:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 -- 172.21.15.42:0/1450175087 shutdown_connections 2024-05-09T01:41:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0045350 con 0x7f91d0006a90 2024-05-09T01:41:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0006570 con 0x7f91d00d56f0 2024-05-09T01:41:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f91d00d5b00 con 0x7f91d00334e0 2024-05-09T01:41:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.983+0000 7efcb67c7640 1 -- 172.21.15.42:0/1450175087 wait complete. 2024-05-09T01:41:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f5629b1b640 1 Processor -- start 2024-05-09T01:41:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 -- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 msgr2=0x7f26740707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 --2- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740707d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f266c009e50 tx=0x7f266c02a710 comp rx=0 tx=0).stop 2024-05-09T01:41:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 -- 172.21.15.42:0/3113864346 shutdown_connections 2024-05-09T01:41:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 --2- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740707d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 --2- 172.21.15.42:0/3113864346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f267415b620 0x7f2674161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 -- 172.21.15.42:0/3113864346 >> 172.21.15.42:0/3113864346 conn(0x7f267406cdc0 msgr2=0x7f26740cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 -- 172.21.15.42:0/3113864346 shutdown_connections 2024-05-09T01:41:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f267c5cf640 1 -- 172.21.15.42:0/3113864346 wait complete. 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f91d659c640 1 -- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00334e0 msgr2=0x7f91d004ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f91d659c640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00334e0 0x7f91d004ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f91d659c640 1 -- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00d56f0 msgr2=0x7f91d00d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f91d659c640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00d56f0 0x7f91d00d3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.984+0000 7f91d659c640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d016f470 con 0x7f91d0006a90 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f91d659c640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 0x7f91d0186260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91d8066140 tx=0x7f91d80755e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fb2c1746640 1 Processor -- start 2024-05-09T01:41:08.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d806ebe0 con 0x7f91d0006a90 2024-05-09T01:41:08.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fb2c1746640 1 -- start start 2024-05-09T01:41:08.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d004fd90 con 0x7f91d0006a90 2024-05-09T01:41:08.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f5629b1b640 1 -- start start 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fa48e056640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 0x7fa4800dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fecfcd4d640 1 -- 172.21.15.42:0/2198490831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068a20 msgr2=0x7fecf80c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/2198490831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068a20 0x7fecf80c48d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecf80cd810 tx=0x7fecf002a6a0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fecfcd4d640 1 -- 172.21.15.42:0/2198490831 shutdown_connections 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/2198490831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068a20 0x7fecf80c48d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/2198490831 >> v2:172.21.15.42:3300/0 conn(0x7fecf81599a0 0x7fecf80ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7fecfcd4d640 1 -- 172.21.15.42:0/2198490831 >> 172.21.15.42:0/2198490831 conn(0x7fecf80cb730 msgr2=0x7fecf806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48d054640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 0x7fa4800dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48d054640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 0x7fa4800dfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35530/0 (socket says 172.21.15.42:35530) 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48d054640 1 -- 172.21.15.42:0/3630046922 learned_addr learned my addr 172.21.15.42:0/3630046922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa4800de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4800483e0 0x7fa4800ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa480034190 con 0x7fa4800464e0 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48c853640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa4800de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fa48d855640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4800483e0 0x7fa4800ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa480047ab0 con 0x7fa4800483e0 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa4800dc0c0 con 0x7fa480047fd0 2024-05-09T01:41:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7fecfcd4d640 1 -- 172.21.15.42:0/2198490831 shutdown_connections 2024-05-09T01:41:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d806ed80 con 0x7f91d0006a90 2024-05-09T01:41:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d0185780 con 0x7f91d0006a90 2024-05-09T01:41:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d806e330 con 0x7f91d0006a90 2024-05-09T01:41:08.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f3c98d73640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94167000 0x7f3c9415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f3c98d73640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 0x7f3c94169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f3c98d73640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c9416a210 0x7f3c94202ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f3c98d73640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94072eb0 con 0x7f3c94169780 2024-05-09T01:41:08.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fb2c1746640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2bc073390 0x7fb2bc162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f3c98d73640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c940c8cf0 con 0x7f3c9416a210 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48d054640 1 -- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 msgr2=0x7fa4800de7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48d054640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa4800de7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48d054640 1 -- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4800483e0 msgr2=0x7fa4800ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48d054640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4800483e0 0x7fa4800ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fa48d054640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4800ded00 con 0x7fa4800464e0 2024-05-09T01:41:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7fb2c1746640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 0x7fb2bc1f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.985+0000 7f3c98d73640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3c940c9e80 con 0x7f3c94167000 2024-05-09T01:41:08.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7f3c92ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 0x7f3c94169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7f3c92ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 0x7f3c94169cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35524/0 (socket says 172.21.15.42:35524) 2024-05-09T01:41:08.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7f3c92ffd640 1 -- 172.21.15.42:0/1101749099 learned_addr learned my addr 172.21.15.42:0/1101749099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c92ffd640 1 -- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94167000 msgr2=0x7f3c9415f750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:41:08.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f267c5cf640 1 Processor -- start 2024-05-09T01:41:08.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94167000 0x7f3c9415f750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c92ffd640 1 -- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c9416a210 msgr2=0x7f3c94202ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:41:08.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f267c5cf640 1 -- start start 2024-05-09T01:41:08.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f5629b1b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f561c006c70 0x7f561c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f5629b1b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 0x7f561c17d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c9416a210 0x7f3c94202ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f5629b1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 0x7f561c0dd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa48d054640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 0x7fa4800dfe80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c760 tx=0x7fa48400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c92ffd640 1 -- 172.21.15.42:0/1101749099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c94168ae0 con 0x7f3c94169780 2024-05-09T01:41:08.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c92ffd640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 0x7f3c94169cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3c8402acd0 tx=0x7f3c840014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f5629b1b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f561c04c2a0 con 0x7f561c0e41b0 2024-05-09T01:41:08.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f5629b1b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f561c04bfc0 con 0x7f561c008160 2024-05-09T01:41:08.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484005ab0 con 0x7fa4800464e0 2024-05-09T01:41:08.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484005c50 con 0x7fa4800464e0 2024-05-09T01:41:08.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484007270 con 0x7fa4800464e0 2024-05-09T01:41:08.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7f5629b1b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f561c0064b0 con 0x7f561c006c70 2024-05-09T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa48d855640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4800483e0 0x7fa4800ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa48c853640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa4800de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84052020 con 0x7f3c94169780 2024-05-09T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa480007d60 con 0x7fa4800464e0 2024-05-09T01:41:08.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c98d73640 1 -- 172.21.15.42:0/1101749099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c94162f70 con 0x7f3c94169780 2024-05-09T01:41:08.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.987+0000 7f3c98d73640 1 -- 172.21.15.42:0/1101749099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c94169060 con 0x7f3c94169780 2024-05-09T01:41:08.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c84038040 con 0x7f3c94169780 2024-05-09T01:41:08.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7efcb67c7640 1 Processor -- start 2024-05-09T01:41:08.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.986+0000 7efcb67c7640 1 -- start start 2024-05-09T01:41:08.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7efcb67c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c004130 0x7efca8171a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7efcb67c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 0x7efca80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7efcb67c7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca80cc190 0x7efca80d7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f91c4ff9640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d0005570 con 0x7f91d0006a90 2024-05-09T01:41:08.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.988+0000 7fecfcd4d640 1 -- 172.21.15.42:0/2198490831 wait complete. 2024-05-09T01:41:08.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 0x7efca80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 0x7efca80cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60542/0 (socket says 172.21.15.42:60542) 2024-05-09T01:41:08.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb67c7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efca80334e0 con 0x7efc9c004130 2024-05-09T01:41:08.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f5623fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 0x7f561c17d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f5623fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 0x7f561c17d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60536/0 (socket says 172.21.15.42:60536) 2024-05-09T01:41:08.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f5623fff640 1 -- 172.21.15.42:0/1539306917 learned_addr learned my addr 172.21.15.42:0/1539306917 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f5628b19640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f561c006c70 0x7f561c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb67c7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efca8034b30 con 0x7efca80daec0 2024-05-09T01:41:08.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb67c7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efca804bd80 con 0x7efca80cc190 2024-05-09T01:41:08.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f5623fff640 1 -- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f561c006c70 msgr2=0x7f561c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f5623fff640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f561c006c70 0x7f561c0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f5623fff640 1 -- 172.21.15.42:0/1539306917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 msgr2=0x7f561c0dd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f5623fff640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 0x7f561c0dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 -- 172.21.15.42:0/683358104 learned_addr learned my addr 172.21.15.42:0/683358104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f5623fff640 1 -- 172.21.15.42:0/1539306917 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c04f240 con 0x7f561c008160 2024-05-09T01:41:08.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb5fc6640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca80cc190 0x7efca80d7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 -- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca80cc190 msgr2=0x7efca80d7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca80cc190 0x7efca80d7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 -- 172.21.15.42:0/683358104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c004130 msgr2=0x7efca8171a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c004130 0x7efca8171a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f5623fff640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 0x7f561c17d060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5610000c00 tx=0x7f56100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7efcb4fc4640 1 -- 172.21.15.42:0/683358104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca8171f90 con 0x7efca80daec0 2024-05-09T01:41:08.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267c5cf640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674073380 0x7f26741faf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7efcb4fc4640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 0x7efca80cbc50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efcb0000b60 tx=0x7efcb00755e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91d808e7d0 con 0x7f91d0006a90 2024-05-09T01:41:08.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb008e7d0 con 0x7efca80daec0 2024-05-09T01:41:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb008e970 con 0x7efca80daec0 2024-05-09T01:41:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267c5cf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.989+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84052020 con 0x7f3c94169780 2024-05-09T01:41:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c78005290 con 0x7f3c94169780 2024-05-09T01:41:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb008ed60 con 0x7efca80daec0 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fecfcd4d640 1 Processor -- start 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fecfcd4d640 1 -- start start 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267c5cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f267415b620 0x7f2674155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267a36b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674073380 0x7f26741faf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267c5cf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26740c9710 con 0x7f267415b620 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267c5cf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f26740c9430 con 0x7f2674073790 2024-05-09T01:41:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7f267c5cf640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f26740c9c30 con 0x7f2674073380 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60558/0 (socket says 172.21.15.42:60558) 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 -- 172.21.15.42:0/2499972606 learned_addr learned my addr 172.21.15.42:0/2499972606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca80d9320 con 0x7efca80daec0 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca80d8d80 con 0x7efca80daec0 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 -- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674073380 msgr2=0x7f26741faf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674073380 0x7f26741faf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f91c6ffd640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91b80763a0 0x7f91b80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2c1746640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2c1746640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0c8f90 con 0x7fb2bc0c9790 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2c1746640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0c8cb0 con 0x7fb2bc073390 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2c1746640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc0c9ba0 con 0x7fb2bc169a50 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 0x7fb2bc1f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 0x7fb2bc1f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35532/0 (socket says 172.21.15.42:35532) 2024-05-09T01:41:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2bb7fe640 1 -- 172.21.15.42:0/2343630231 learned_addr learned my addr 172.21.15.42:0/2343630231 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.990+0000 7fb2bbfff640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2bc073390 0x7fb2bc162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bbfff640 1 -- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 msgr2=0x7fb2bc153f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bbfff640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc153f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bbfff640 1 -- 172.21.15.42:0/2343630231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 msgr2=0x7fb2bc1f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bbfff640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 0x7fb2bc1f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bbfff640 1 -- 172.21.15.42:0/2343630231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc1fa470 con 0x7fb2bc073390 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bb7fe640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 0x7fb2bc1f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7fb2bbfff640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2bc073390 0x7fb2bc162990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c390 tx=0x7fb2ac00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 -- 172.21.15.42:0/2499972606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f267415b620 msgr2=0x7f2674155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f267415b620 0x7f2674155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91d8114a40 con 0x7f91d0006a90 2024-05-09T01:41:08.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.991+0000 7f2679b6a640 1 -- 172.21.15.42:0/2499972606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26741fb4c0 con 0x7f2674073790 2024-05-09T01:41:08.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7f91d5d9b640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91b80763a0 0x7f91b80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac017070 con 0x7fb2bc073390 2024-05-09T01:41:08.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca8005570 con 0x7efca80daec0 2024-05-09T01:41:08.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7fb2c1746640 1 -- 172.21.15.42:0/2343630231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc1634d0 con 0x7fb2bc073390 2024-05-09T01:41:08.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7fb2c1746640 1 -- 172.21.15.42:0/2343630231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc1fa9f0 con 0x7fb2bc073390 2024-05-09T01:41:08.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac005ce0 con 0x7fb2bc073390 2024-05-09T01:41:08.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.992+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0072d0 con 0x7fb2bc073390 2024-05-09T01:41:08.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f2679b6a640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740cbce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f266400b450 tx=0x7f266400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610037040 con 0x7f561c008160 2024-05-09T01:41:08.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7fecfcd4d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068610 0x7fecf8153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7fecfcd4d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 0x7fecf8158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5610042070 con 0x7f561c008160 2024-05-09T01:41:08.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7fecfcd4d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecf81599a0 0x7fecf8146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561c17d5a0 con 0x7f561c008160 2024-05-09T01:41:08.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561c0d6f40 con 0x7f561c008160 2024-05-09T01:41:08.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610030920 con 0x7f561c008160 2024-05-09T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7f91d5d9b640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91b80763a0 0x7f91b80788b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91c8034000 tx=0x7f91c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7fb2c1746640 1 -- 172.21.15.42:0/2343630231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2bc06a5e0 con 0x7fb2bc073390 2024-05-09T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.993+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcb0096390 con 0x7efca80daec0 2024-05-09T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3c84055020 con 0x7f3c94169780 2024-05-09T01:41:08.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7efca5ffb640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7efc94076350 0x7efc94078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7efcb57c5640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7efc94076350 0x7efc94078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efcb00da150 con 0x7efca80daec0 2024-05-09T01:41:08.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664015020 con 0x7f2674073790 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7fecf5d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 0x7fecf8158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7fecf5d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 0x7fecf8158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:36436/0 (socket says 172.21.15.42:36436) 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7fecf659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068610 0x7fecf8153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7fecf659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068610 0x7fecf8153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60572/0 (socket says 172.21.15.42:60572) 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf5d9b640 1 -- 172.21.15.42:0/262222436 learned_addr learned my addr 172.21.15.42:0/262222436 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecf806f220 con 0x7fecf81599a0 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf6d9d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecf81599a0 0x7fecf8146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fecf806ef40 con 0x7fecf8068610 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fecf806f500 con 0x7fecf8068a20 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf6d9d640 1 -- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 msgr2=0x7fecf8158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf6d9d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 0x7fecf8158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf6d9d640 1 -- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068610 msgr2=0x7fecf8153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf6d9d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068610 0x7fecf8153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf6d9d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf8156e30 con 0x7fecf81599a0 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fecf5d9b640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 0x7fecf8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7efcb57c5640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7efc94076350 0x7efc94078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcac00a9d0 tx=0x7efcac00a470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664011890 con 0x7f2674073790 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7f267c5cf640 1 -- 172.21.15.42:0/2499972606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26740ce040 con 0x7f2674073790 2024-05-09T01:41:08.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7f267c5cf640 1 -- 172.21.15.42:0/2499972606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26740ce300 con 0x7f2674073790 2024-05-09T01:41:08.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.994+0000 7f3c8bfff640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3c740764d0 0x7f3c740789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7f3c937fe640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3c740764d0 0x7f3c740789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7f3c937fe640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3c740764d0 0x7f3c740789e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c940c8450 tx=0x7f3c7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561c0dda60 con 0x7f561c008160 2024-05-09T01:41:08.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa484007410 con 0x7fa4800464e0 2024-05-09T01:41:08.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664011c60 con 0x7f2674073790 2024-05-09T01:41:08.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2ac01a070 con 0x7fb2bc073390 2024-05-09T01:41:08.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7fecf6d9d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecf81599a0 0x7fecf8146ae0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fecf0030000 tx=0x7fecf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.995+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa480008a50 con 0x7fa4800464e0 2024-05-09T01:41:08.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26740ca570 con 0x7f2674073790 2024-05-09T01:41:08.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5610030ac0 con 0x7f561c008160 2024-05-09T01:41:08.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7fa47dffb640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa46c076350 0x7fa46c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.996+0000 7fa48c853640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa46c076350 0x7fa46c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7fb2b8ff9640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb2a80763a0 0x7fb2a80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4800059c0 con 0x7fa4800464e0 2024-05-09T01:41:08.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2ac096cd0 con 0x7fb2bc073390 2024-05-09T01:41:08.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7fb2bb7fe640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb2a80763a0 0x7fb2a80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7f56217fa640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56080763a0 0x7f56080788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56100b7d70 con 0x7f561c008160 2024-05-09T01:41:08.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7f5628b19640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56080763a0 0x7f56080788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7fa48c853640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa46c076350 0x7fa46c078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa478034000 tx=0x7fa47802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.997+0000 7fb2bb7fe640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb2a80763a0 0x7fb2a80788b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc15eca0 tx=0x7fb2b0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.998+0000 7f5628b19640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56080763a0 0x7f56080788b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5624075c40 tx=0x7f5624051850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.999+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c840c7c80 con 0x7f3c94169780 2024-05-09T01:41:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.999+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa48405bde0 con 0x7fa4800464e0 2024-05-09T01:41:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.999+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91d80ddca0 con 0x7f91d0006a90 2024-05-09T01:41:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.999+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0036050 con 0x7fecf81599a0 2024-05-09T01:41:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.999+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf8157110 con 0x7fecf81599a0 2024-05-09T01:41:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:07.999+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf81576d0 con 0x7fecf81599a0 2024-05-09T01:41:08.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.000+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2ac05ffc0 con 0x7fb2bc073390 2024-05-09T01:41:08.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.001+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf806a500 con 0x7fecf81599a0 2024-05-09T01:41:08.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.005+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efcb009d030 con 0x7efca80daec0 2024-05-09T01:41:08.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.006+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3c8405c020 con 0x7f3c94169780 2024-05-09T01:41:08.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.007+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2664018020 con 0x7f2674073790 2024-05-09T01:41:08.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.007+0000 7f266affd640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2658076350 0x7f2658078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.008+0000 7f267a36b640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2658076350 0x7f2658078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.008+0000 7f267a36b640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2658076350 0x7f2658078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2670007980 tx=0x7f2670008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.009+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0042070 con 0x7fecf81599a0 2024-05-09T01:41:08.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.009+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0032030 con 0x7fecf81599a0 2024-05-09T01:41:08.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.010+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa484060250 con 0x7fa4800464e0 2024-05-09T01:41:08.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.010+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2664011e00 con 0x7f2674073790 2024-05-09T01:41:08.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.011+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56100bc070 con 0x7f561c008160 2024-05-09T01:41:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.012+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fecf00321d0 con 0x7fecf81599a0 2024-05-09T01:41:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.013+0000 7fece6ffd640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fecd80762d0 0x7fecd80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.013+0000 7fecf659c640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fecd80762d0 0x7fecd80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.013+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fecf00b9210 con 0x7fecf81599a0 2024-05-09T01:41:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.014+0000 7fecf659c640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fecd80762d0 0x7fecd80787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fecf80cc730 tx=0x7fecec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.015+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f266401f030 con 0x7f2674073790 2024-05-09T01:41:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.020+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fecf80701f0 con 0x7fecf81599a0 2024-05-09T01:41:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.448+0000 7f91c4ff9640 1 -- 172.21.15.42:0/38179741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f91d0036020 con 0x7f91d0006a90 2024-05-09T01:41:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.448+0000 7fb2c1746640 1 -- 172.21.15.42:0/2343630231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb2bc154b10 con 0x7fb2bc073390 2024-05-09T01:41:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.449+0000 7fb2b8ff9640 1 -- 172.21.15.42:0/2343630231 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2ac0642c0 con 0x7fb2bc073390 2024-05-09T01:41:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.449+0000 7f91c6ffd640 1 -- 172.21.15.42:0/38179741 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91d80e6370 con 0x7f91d0006a90 2024-05-09T01:41:08.447 INFO:teuthology.orchestra.run.smithi042.stdout:60129542151 2024-05-09T01:41:08.447 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2024-05-09T01:41:08.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7fb2a27fc640 1 -- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb2a80763a0 msgr2=0x7fb2a80788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7fb2a27fc640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb2a80763a0 0x7fb2a80788b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc15eca0 tx=0x7fb2b0009190 comp rx=0 tx=0).stop 2024-05-09T01:41:08.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91b80763a0 msgr2=0x7f91b80788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7fb2a27fc640 1 -- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2bc073390 msgr2=0x7fb2bc162990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7fb2a27fc640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2bc073390 0x7fb2bc162990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c390 tx=0x7fb2ac00c850 comp rx=0 tx=0).stop 2024-05-09T01:41:08.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91b80763a0 0x7f91b80788b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91c8034000 tx=0x7f91c802e000 comp rx=0 tx=0).stop 2024-05-09T01:41:08.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 msgr2=0x7f91d0186260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 0x7f91d0186260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91d8066140 tx=0x7f91d80755e0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 shutdown_connections 2024-05-09T01:41:08.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7fb2a27fc640 1 -- 172.21.15.42:0/2343630231 shutdown_connections 2024-05-09T01:41:08.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.453+0000 7fb2a27fc640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb2a80763a0 0x7fb2a80788b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7fb2a27fc640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb2bc169a50 0x7fb2bc153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7fb2a27fc640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2bc0c9790 0x7fb2bc1f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7fb2a27fc640 1 --2- 172.21.15.42:0/2343630231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2bc073390 0x7fb2bc162990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7fb2a27fc640 1 -- 172.21.15.42:0/2343630231 >> 172.21.15.42:0/2343630231 conn(0x7fb2bc06d100 msgr2=0x7fb2bc0c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91b80763a0 0x7f91b80788b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00d56f0 0x7f91d00d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00334e0 0x7f91d004ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7fb2a27fc640 1 -- 172.21.15.42:0/2343630231 shutdown_connections 2024-05-09T01:41:08.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7fb2a27fc640 1 -- 172.21.15.42:0/2343630231 wait complete. 2024-05-09T01:41:08.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 --2- 172.21.15.42:0/38179741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d0006a90 0x7f91d0186260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 >> 172.21.15.42:0/38179741 conn(0x7f91d00503b0 msgr2=0x7f91d004c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 shutdown_connections 2024-05-09T01:41:08.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.454+0000 7f91d759e640 1 -- 172.21.15.42:0/38179741 wait complete. 2024-05-09T01:41:08.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.457+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efca80e0cc0 con 0x7efca80daec0 2024-05-09T01:41:08.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.458+0000 7efca5ffb640 1 -- 172.21.15.42:0/683358104 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efcb009d030 con 0x7efca80daec0 2024-05-09T01:41:08.456 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-05-09T01:41:08.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.461+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3c78005850 con 0x7f3c94169780 2024-05-09T01:41:08.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7efc94076350 msgr2=0x7efc94078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7efc94076350 0x7efc94078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcac00a9d0 tx=0x7efcac00a470 comp rx=0 tx=0).stop 2024-05-09T01:41:08.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 msgr2=0x7efca80cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 0x7efca80cbc50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efcb0000b60 tx=0x7efcb00755e0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.460 INFO:teuthology.orchestra.run.smithi042.stdout:60129542149 2024-05-09T01:41:08.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7f3c8bfff640 1 -- 172.21.15.42:0/1101749099 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c84092f10 con 0x7f3c94169780 2024-05-09T01:41:08.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 shutdown_connections 2024-05-09T01:41:08.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7efc94076350 0x7efc94078860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca80cc190 0x7efca80d7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca80daec0 0x7efca80cbc50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 --2- 172.21.15.42:0/683358104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9c004130 0x7efca8171a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 >> 172.21.15.42:0/683358104 conn(0x7efca80503b0 msgr2=0x7efca8033e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f561c0059c0 con 0x7f561c008160 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 shutdown_connections 2024-05-09T01:41:08.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.462+0000 7efcb67c7640 1 -- 172.21.15.42:0/683358104 wait complete. 2024-05-09T01:41:08.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.463+0000 7f56217fa640 1 -- 172.21.15.42:0/1539306917 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f561c04f240 con 0x7f561c008160 2024-05-09T01:41:08.462 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-05-09T01:41:08.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.465+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa4800db1c0 con 0x7fa4800464e0 2024-05-09T01:41:08.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f26740ca2c0 con 0x7f2674073790 2024-05-09T01:41:08.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3c740764d0 msgr2=0x7f3c740789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3c740764d0 0x7f3c740789e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c940c8450 tx=0x7f3c7c009040 comp rx=0 tx=0).stop 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 msgr2=0x7f3c94169cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 0x7f3c94169cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3c8402acd0 tx=0x7f3c840014a0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 shutdown_connections 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3c740764d0 0x7f3c740789e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c9416a210 0x7f3c94202ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c94169780 0x7f3c94169cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 --2- 172.21.15.42:0/1101749099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c94167000 0x7f3c9415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 >> 172.21.15.42:0/1101749099 conn(0x7f3c9406d100 msgr2=0x7f3c940cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 shutdown_connections 2024-05-09T01:41:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f3c89ffb640 1 -- 172.21.15.42:0/1101749099 wait complete. 2024-05-09T01:41:08.466 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-05-09T01:41:08.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.466+0000 7fa47dffb640 1 -- 172.21.15.42:0/3630046922 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa48405fb50 con 0x7fa4800464e0 2024-05-09T01:41:08.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56080763a0 msgr2=0x7f56080788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56080763a0 0x7f56080788b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5624075c40 tx=0x7f5624051850 comp rx=0 tx=0).stop 2024-05-09T01:41:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 msgr2=0x7f561c17d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 0x7f561c17d060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5610000c00 tx=0x7f56100046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.467+0000 7f266affd640 1 -- 172.21.15.42:0/2499972606 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f266400d040 con 0x7f2674073790 2024-05-09T01:41:08.467 INFO:teuthology.orchestra.run.smithi042.stdout:60129542149 2024-05-09T01:41:08.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 shutdown_connections 2024-05-09T01:41:08.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56080763a0 0x7f56080788b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f561c0e41b0 0x7f561c0dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f561c008160 0x7f561c17d060 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 --2- 172.21.15.42:0/1539306917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f561c006c70 0x7f561c0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 >> 172.21.15.42:0/1539306917 conn(0x7f561c050c40 msgr2=0x7f561c005bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 shutdown_connections 2024-05-09T01:41:08.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.468+0000 7f5629b1b640 1 -- 172.21.15.42:0/1539306917 wait complete. 2024-05-09T01:41:08.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.470+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa46c076350 msgr2=0x7fa46c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.470+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa46c076350 0x7fa46c078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa478034000 tx=0x7fa47802e000 comp rx=0 tx=0).stop 2024-05-09T01:41:08.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.470+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 msgr2=0x7fa4800dfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.470+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 0x7fa4800dfe80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c760 tx=0x7fa48400cc20 comp rx=0 tx=0).stop 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.470+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 shutdown_connections 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa46c076350 0x7fa46c078860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4800483e0 0x7fa4800ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa480047fd0 0x7fa4800de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 --2- 172.21.15.42:0/3630046922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4800464e0 0x7fa4800dfe80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 >> 172.21.15.42:0/3630046922 conn(0x7fa480051540 msgr2=0x7fa4800d9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 shutdown_connections 2024-05-09T01:41:08.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7fa48e056640 1 -- 172.21.15.42:0/3630046922 wait complete. 2024-05-09T01:41:08.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.471+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2658076350 msgr2=0x7f2658078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2658076350 0x7f2658078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2670007980 tx=0x7f2670008040 comp rx=0 tx=0).stop 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 msgr2=0x7f26740cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740cbce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f266400b450 tx=0x7f266400b910 comp rx=0 tx=0).stop 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 shutdown_connections 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2658076350 0x7f2658078860 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f267415b620 0x7f2674155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2674073790 0x7f26740cbce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 --2- 172.21.15.42:0/2499972606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674073380 0x7f26741faf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.472+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 >> 172.21.15.42:0/2499972606 conn(0x7f267406cdc0 msgr2=0x7f26740c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.473+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 shutdown_connections 2024-05-09T01:41:08.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.473+0000 7f2668ff9640 1 -- 172.21.15.42:0/2499972606 wait complete. 2024-05-09T01:41:08.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.473+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fecf80ce020 con 0x7fecf81599a0 2024-05-09T01:41:08.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.474+0000 7fece6ffd640 1 -- 172.21.15.42:0/262222436 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecf00324c0 con 0x7fecf81599a0 2024-05-09T01:41:08.474 INFO:teuthology.orchestra.run.smithi042.stdout:55834574854 2024-05-09T01:41:08.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.0 2024-05-09T01:41:08.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.1 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fecd80762d0 msgr2=0x7fecd80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fecd80762d0 0x7fecd80787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fecf80cc730 tx=0x7fecec008040 comp rx=0 tx=0).stop 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecf81599a0 msgr2=0x7fecf8146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecf81599a0 0x7fecf8146ae0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fecf0030000 tx=0x7fecf0004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 shutdown_connections 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fecd80762d0 0x7fecd80787e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecf81599a0 0x7fecf8146ae0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecf8068a20 0x7fecf8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 --2- 172.21.15.42:0/262222436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf8068610 0x7fecf8153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.478+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 >> 172.21.15.42:0/262222436 conn(0x7fecf80cb730 msgr2=0x7fecf806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:08.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.479+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 shutdown_connections 2024-05-09T01:41:08.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:08.479+0000 7fecfcd4d640 1 -- 172.21.15.42:0/262222436 wait complete. 2024-05-09T01:41:08.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.6 2024-05-09T01:41:08.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.3 2024-05-09T01:41:08.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2024-05-09T01:41:08.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.7 2024-05-09T01:41:08.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.5 2024-05-09T01:41:08.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-05-09T01:41:09.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T01:41:09.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T01:41:09.484 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T01:41:09.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T01:41:09.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T01:41:09.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T01:41:09.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T01:41:09.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T01:41:09.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.680+0000 7f6f0b061640 1 Processor -- start 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.676+0000 7fbf07fff640 1 Processor -- start 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.677+0000 7fbf07fff640 1 -- start start 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.680+0000 7fbf07fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf000457a0 0x7fbf000064e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7fbf07fff640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0004cff0 con 0x7fbf00046450 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7fbf07fff640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf00045d00 con 0x7fbf000e79a0 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7fbf07fff640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbf00006a20 con 0x7fbf000457a0 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7fbf077fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbf000e79a0 0x7fbf000ee0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42876/0 (socket says 172.21.15.42:42876) 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7fbf077fe640 1 -- 172.21.15.42:0/3318912322 learned_addr learned my addr 172.21.15.42:0/3318912322 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7fbf067fc640 1 --2- 172.21.15.42:0/3318912322 >> v2:172.21.15.181:3300/0 conn(0x7fbf000457a0 0x7fbf000064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.682+0000 7fbf067fc640 1 -- 172.21.15.42:0/3318912322 >> v1:172.21.15.181:6789/0 conn(0x7fbf000e79a0 legacy=0x7fbf000ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.682+0000 7fbf067fc640 1 -- 172.21.15.42:0/3318912322 >> v1:172.21.15.42:6789/0 conn(0x7fbf00046450 legacy=0x7fbf0004bb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:41:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.683+0000 7fbf067fc640 1 -- 172.21.15.42:0/3318912322 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf00045fe0 con 0x7fbf000457a0 2024-05-09T01:41:09.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.685+0000 7fbf067fc640 1 --2- 172.21.15.42:0/3318912322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000457a0 0x7fbf000064e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf00033540 tx=0x7fbef8029f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23797fdf6dbad6b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.681+0000 7f6f0b061640 1 -- start start 2024-05-09T01:41:09.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.686+0000 7fbf05ffb640 1 -- 172.21.15.42:0/3318912322 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8037070 con 0x7fbf000457a0 2024-05-09T01:41:09.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.686+0000 7fbf05ffb640 1 -- 172.21.15.42:0/3318912322 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef802ace0 con 0x7fbf000457a0 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.684+0000 7f6f0b061640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.685+0000 7f6f0b061640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f041634d0 0x7f6f041658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.685+0000 7f6f0b061640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f0415b6f0 con 0x7f6f040cc710 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.685+0000 7f6f0b061640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0415b9d0 con 0x7f6f041634d0 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.685+0000 7f6f0b061640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0415e430 con 0x7f6f040cb2f0 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.686+0000 7f6f095fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f041634d0 0x7f6f041658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.686+0000 7f6f095fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f041634d0 0x7f6f041658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60584/0 (socket says 172.21.15.42:60584) 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.686+0000 7f6f095fe640 1 -- 172.21.15.42:0/1184792374 learned_addr learned my addr 172.21.15.42:0/1184792374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.686+0000 7f6f08dfd640 1 --2- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.687+0000 7f6f095fe640 1 -- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 msgr2=0x7f6f040c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.687+0000 7f6f095fe640 1 --2- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.687+0000 7f6f095fe640 1 -- 172.21.15.42:0/1184792374 >> v1:172.21.15.181:6789/0 conn(0x7f6f040cc710 legacy=0x7f6f040ccb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:41:09.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.687+0000 7f6f095fe640 1 -- 172.21.15.42:0/1184792374 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0415e710 con 0x7f6f041634d0 2024-05-09T01:41:09.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.687+0000 7fbf07fff640 1 -- 172.21.15.42:0/3318912322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000457a0 msgr2=0x7fbf000064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.687+0000 7fbf07fff640 1 --2- 172.21.15.42:0/3318912322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000457a0 0x7fbf000064e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf00033540 tx=0x7fbef8029f90 comp rx=0 tx=0).stop 2024-05-09T01:41:09.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.688+0000 7fbf07fff640 1 -- 172.21.15.42:0/3318912322 shutdown_connections 2024-05-09T01:41:09.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.688+0000 7fbf07fff640 1 --2- 172.21.15.42:0/3318912322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000457a0 0x7fbf000064e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.688+0000 7fbf07fff640 1 -- 172.21.15.42:0/3318912322 >> 172.21.15.42:0/3318912322 conn(0x7fbf00050800 msgr2=0x7fbf00050c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.688+0000 7fbf07fff640 1 -- 172.21.15.42:0/3318912322 shutdown_connections 2024-05-09T01:41:09.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.688+0000 7fbf07fff640 1 -- 172.21.15.42:0/3318912322 wait complete. 2024-05-09T01:41:09.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.688+0000 7f6f095fe640 1 --2- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f041658f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4014a00 tx=0x7f6ef403ba60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=110a47c92fb4ee3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.689+0000 7f6f037fe640 1 -- 172.21.15.42:0/1184792374 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4043070 con 0x7f6f041634d0 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.689+0000 7f6f037fe640 1 -- 172.21.15.42:0/1184792374 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef40114e0 con 0x7f6f041634d0 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.689+0000 7f6f037fe640 1 -- 172.21.15.42:0/1184792374 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40118f0 con 0x7f6f041634d0 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.690+0000 7f6f0b061640 1 -- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 msgr2=0x7f6f041658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.690+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f041658f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4014a00 tx=0x7f6ef403ba60 comp rx=0 tx=0).stop 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7f6f0b061640 1 -- 172.21.15.42:0/1184792374 shutdown_connections 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f041658f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1184792374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7f6f0b061640 1 -- 172.21.15.42:0/1184792374 >> 172.21.15.42:0/1184792374 conn(0x7f6f04072890 msgr2=0x7f6f04072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7f6f0b061640 1 -- 172.21.15.42:0/1184792374 shutdown_connections 2024-05-09T01:41:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7fbf07fff640 1 Processor -- start 2024-05-09T01:41:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7fbf07fff640 1 -- start start 2024-05-09T01:41:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.693+0000 7fbf07fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf00046450 0x7fbf000deba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7fbf07fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 0x7fbf000d7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.691+0000 7f6f0b061640 1 -- 172.21.15.42:0/1184792374 wait complete. 2024-05-09T01:41:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7f6f0b061640 1 Processor -- start 2024-05-09T01:41:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7fbf07fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 0x7fbf000d78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7fbf06ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf00046450 0x7fbf000deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7f6f0b061640 1 -- start start 2024-05-09T01:41:09.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7fbf06ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf00046450 0x7fbf000deba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:36454/0 (socket says 172.21.15.42:36454) 2024-05-09T01:41:09.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7fbf067fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 0x7fbf000d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.694+0000 7fbf067fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 0x7fbf000d7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60596/0 (socket says 172.21.15.42:60596) 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.695+0000 7fbf077fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 0x7fbf000d78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.695+0000 7fbf077fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 0x7fbf000d78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35572/0 (socket says 172.21.15.42:35572) 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.695+0000 7fbf07fff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000e71a0 con 0x7fbf000e3350 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.695+0000 7fbf07fff640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000e7510 con 0x7fbf000e79a0 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.695+0000 7fbf07fff640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0004c290 con 0x7fbf00046450 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.695+0000 7fbf06ffd640 1 -- 172.21.15.42:0/2176773736 learned_addr learned my addr 172.21.15.42:0/2176773736 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.696+0000 7fbf077fe640 1 -- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf00046450 msgr2=0x7fbf000deba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.696+0000 7fbf077fe640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf00046450 0x7fbf000deba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f0b061640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.696+0000 7fbf077fe640 1 -- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 msgr2=0x7fbf000d7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.696+0000 7fbf077fe640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 0x7fbf000d7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f0b061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 0x7f6f04153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.696+0000 7fbf077fe640 1 -- 172.21.15.42:0/2176773736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000df470 con 0x7fbf000e3350 2024-05-09T01:41:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.696+0000 7fbf077fe640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 0x7fbf000d78c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbf0806bcd0 tx=0x7fbf080755e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f0b061640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f04152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f03fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 0x7f6f04153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f0b061640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f04154f90 con 0x7f6f040cc710 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f0b061640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0415e120 con 0x7f6f041634d0 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f0b061640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f040cc0e0 con 0x7f6f040cb2f0 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7f6f03fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 0x7f6f04153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35584/0 (socket says 172.21.15.42:35584) 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f03fff640 1 -- 172.21.15.42:0/1450224084 learned_addr learned my addr 172.21.15.42:0/1450224084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f08dfd640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f095fe640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f04152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f03fff640 1 -- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 msgr2=0x7f6f040c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f03fff640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f03fff640 1 -- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 msgr2=0x7f6f04152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f03fff640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f04152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7f6f03fff640 1 -- 172.21.15.42:0/1450224084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f041ef970 con 0x7f6f040cc710 2024-05-09T01:41:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.699+0000 7f6f03fff640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 0x7f6f04153c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800b3c0 tx=0x7f6ef800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.697+0000 7fbf067fc640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 0x7fbf000d7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-09T01:41:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0806ebe0 con 0x7fbf000e3350 2024-05-09T01:41:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0806edc0 con 0x7fbf000e3350 2024-05-09T01:41:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.698+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0806e330 con 0x7fbf000e3350 2024-05-09T01:41:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.699+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf000e01f0 con 0x7fbf000e3350 2024-05-09T01:41:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.699+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8011830 con 0x7f6f040cc710 2024-05-09T01:41:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.699+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f040c6f10 con 0x7f6f040cc710 2024-05-09T01:41:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.699+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f041efed0 con 0x7f6f040cc710 2024-05-09T01:41:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.700+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8016070 con 0x7f6f040cc710 2024-05-09T01:41:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.701+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8011830 con 0x7f6f040cc710 2024-05-09T01:41:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.703+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee4005290 con 0x7f6f040cc710 2024-05-09T01:41:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.706+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ef80119d0 con 0x7f6f040cc710 2024-05-09T01:41:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.706+0000 7f6f017fa640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6ef00766d0 0x7f6ef0078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.707+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6ef8011630 con 0x7f6f040cc710 2024-05-09T01:41:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.703+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf000df9f0 con 0x7fbf000e3350 2024-05-09T01:41:09.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.704+0000 7fbeedffb640 1 -- 172.21.15.42:0/2176773736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee0005290 con 0x7fbf000e3350 2024-05-09T01:41:09.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.707+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf0808e7d0 con 0x7fbf000e3350 2024-05-09T01:41:09.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.708+0000 7fbeeffff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbef4076350 0x7fbef4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.709+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbf08112350 con 0x7fbf000e3350 2024-05-09T01:41:09.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.709+0000 7fbf06ffd640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbef4076350 0x7fbef4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.709+0000 7f6f08dfd640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6ef00766d0 0x7f6ef0078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.710+0000 7fbf06ffd640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbef4076350 0x7fbef4078860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbefc006fd0 tx=0x7fbefc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.710+0000 7f6f08dfd640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6ef00766d0 0x7f6ef0078be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009aa0 tx=0x7f6efc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.715+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf080dd670 con 0x7fbf000e3350 2024-05-09T01:41:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.732+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6f041ef970 con 0x7f6f040cc710 2024-05-09T01:41:09.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.745+0000 7f1e35557640 1 Processor -- start 2024-05-09T01:41:09.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.745+0000 7f1e35557640 1 -- start start 2024-05-09T01:41:09.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.747+0000 7f1e35557640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 0x7f1e300700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.747+0000 7f1e35557640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e30070600 0x7f1e3016bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.747+0000 7f1e35557640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e30073a90 con 0x7f1e30161200 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.747+0000 7f1e35557640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f1e300c97a0 con 0x7f1e30070600 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.747+0000 7f1e35557640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1e300c88b0 con 0x7f1e3015b490 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e30070600 0x7f1e3016bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e30070600 0x7f1e3016bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35598/0 (socket says 172.21.15.42:35598) 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 -- 172.21.15.42:0/698832073 learned_addr learned my addr 172.21.15.42:0/698832073 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 -- 172.21.15.42:0/698832073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 msgr2=0x7f1e300700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 --2- 172.21.15.42:0/698832073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 0x7f1e300700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 -- 172.21.15.42:0/698832073 >> v1:172.21.15.181:6789/0 conn(0x7f1e30161200 legacy=0x7f1e30073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.748+0000 7f1e2f7fe640 1 -- 172.21.15.42:0/698832073 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e300c8b90 con 0x7f1e30070600 2024-05-09T01:41:09.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.750+0000 7f1e2f7fe640 1 --2- 172.21.15.42:0/698832073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30070600 0x7f1e3016bb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009870 tx=0x7f1e2402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271ad74089e8e58e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.750+0000 7f1e2dffb640 1 -- 172.21.15.42:0/698832073 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24037070 con 0x7f1e30070600 2024-05-09T01:41:09.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7f1e2dffb640 1 -- 172.21.15.42:0/698832073 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e24032440 con 0x7f1e30070600 2024-05-09T01:41:09.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7f166cb76640 1 Processor -- start 2024-05-09T01:41:09.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7f166cb76640 1 -- start start 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7f1e2dffb640 1 -- 172.21.15.42:0/698832073 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24032810 con 0x7f1e30070600 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7f1e35557640 1 -- 172.21.15.42:0/698832073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30070600 msgr2=0x7f1e3016bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7f1e35557640 1 --2- 172.21.15.42:0/698832073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30070600 0x7f1e3016bb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009870 tx=0x7f1e2402a1f0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7f1e35557640 1 -- 172.21.15.42:0/698832073 shutdown_connections 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7f1e35557640 1 --2- 172.21.15.42:0/698832073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30070600 0x7f1e3016bb80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7f1e35557640 1 --2- 172.21.15.42:0/698832073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 0x7f1e300700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7f1e35557640 1 -- 172.21.15.42:0/698832073 >> 172.21.15.42:0/698832073 conn(0x7f1e3006cdc0 msgr2=0x7f1e300cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.749+0000 7fbe49710640 1 Processor -- start 2024-05-09T01:41:09.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.749+0000 7fbe49710640 1 -- start start 2024-05-09T01:41:09.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7fbe49710640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe3c045340 0x7fbe3c04c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7fbe49710640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe3c1008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7fbe49710640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c0f75b0 con 0x7fbe3c0f71a0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7fbe49710640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3c033140 con 0x7fbe3c045340 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.751+0000 7fbe49710640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c006e10 con 0x7fbe3c1004e0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7fbe43fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe3c045340 0x7fbe3c04c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7fbe437fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbe3c0f71a0 0x7fbe3c0072a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50366/0 (socket says 172.21.15.42:50366) 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7fbe437fe640 1 -- 172.21.15.42:0/2631649576 learned_addr learned my addr 172.21.15.42:0/2631649576 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7fbe43fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe3c045340 0x7fbe3c04c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35608/0 (socket says 172.21.15.42:35608) 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784564051 0 0) 0x7fbe3c0f75b0 con 0x7fbe3c0f71a0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe34003500 con 0x7fbe3c0f71a0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.752+0000 7fbe48f0f640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe3c1008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 205126100 0 0) 0x7fbe34003500 con 0x7fbe3c0f71a0 2024-05-09T01:41:09.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 msgr2=0x7fbe3c1008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe3c1008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 >> v2:172.21.15.42:3300/0 conn(0x7fbe3c045340 msgr2=0x7fbe3c04c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 --2- 172.21.15.42:0/2631649576 >> v2:172.21.15.42:3300/0 conn(0x7fbe3c045340 0x7fbe3c04c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c006200 con 0x7fbe3c0f71a0 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe43fff640 1 --2- 172.21.15.42:0/2631649576 >> v2:172.21.15.42:3300/0 conn(0x7fbe3c045340 0x7fbe3c04c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7fbe300016f0 con 0x7fbe3c0f71a0 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 >> v1:172.21.15.42:6789/0 conn(0x7fbe3c0f71a0 legacy=0x7fbe3c0072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe34003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe34004140 0x7fbe34004610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe34004d60 0x7fbe34005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c033140 con 0x7fbe34004d60 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c006e10 con 0x7fbe34004140 2024-05-09T01:41:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3400bca0 con 0x7fbe3c1004e0 2024-05-09T01:41:09.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.753+0000 7f1e35557640 1 -- 172.21.15.42:0/698832073 shutdown_connections 2024-05-09T01:41:09.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fef03fff640 1 Processor -- start 2024-05-09T01:41:09.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7f1e35557640 1 -- 172.21.15.42:0/698832073 wait complete. 2024-05-09T01:41:09.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe43fff640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe34003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe48f0f640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe34004d60 0x7fbe34005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe437fe640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe34004140 0x7fbe34004610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fef03fff640 1 -- start start 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe43fff640 1 -- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe34004140 msgr2=0x7fbe34004610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe43fff640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe34004140 0x7fbe34004610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe43fff640 1 -- 172.21.15.42:0/2631649576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe34004d60 msgr2=0x7fbe34005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe43fff640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe34004d60 0x7fbe34005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe43fff640 1 -- 172.21.15.42:0/2631649576 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c006200 con 0x7fbe3c1004e0 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.754+0000 7fbe48f0f640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe34004d60 0x7fbe34005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7fbe437fe640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe34004140 0x7fbe34004610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:09.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f0bbfa27640 1 Processor -- start 2024-05-09T01:41:09.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7fbe43fff640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe34003bc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe44051620 tx=0x7fbe34003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c5f8dda593f085 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f69c6234640 1 Processor -- start 2024-05-09T01:41:09.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f166cb76640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16680ca350 0x7f166815b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f166cb76640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f166815b580 0x7f16681654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f166cb76640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16680ca760 con 0x7f1668073930 2024-05-09T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f166cb76640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f166815ab40 con 0x7f166815b580 2024-05-09T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f166cb76640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f16680742e0 con 0x7f16680ca350 2024-05-09T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7f69c6234640 1 -- start start 2024-05-09T01:41:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7f166659c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1668073930 0x7f166806c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50382/0 (socket says 172.21.15.42:50382) 2024-05-09T01:41:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7f166659c640 1 -- 172.21.15.42:0/3117632321 learned_addr learned my addr 172.21.15.42:0/3117632321 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef03fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fef04071b00 0x7fef040ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef03fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fef04161310 0x7fef04161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef03fff640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0406dd50 con 0x7fef040cc070 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef03fff640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fef0406e030 con 0x7fef04071b00 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef03fff640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fef0406e310 con 0x7fef04161310 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7f1666d9d640 1 --2- 172.21.15.42:0/3117632321 >> v2:172.21.15.42:3300/0 conn(0x7f166815b580 0x7f16681654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef037fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fef04161310 0x7fef04161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef02ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fef040cc070 0x7fef040cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42900/0 (socket says 172.21.15.42:42900) 2024-05-09T01:41:09.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7fef02ffd640 1 -- 172.21.15.42:0/480272774 learned_addr learned my addr 172.21.15.42:0/480272774 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:09.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.756+0000 7feefbfff640 1 --2- 172.21.15.42:0/480272774 >> v2:172.21.15.42:3300/0 conn(0x7fef04071b00 0x7fef040ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f1665d9b640 1 --2- 172.21.15.42:0/3117632321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16680ca350 0x7f166815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f1e35557640 1 Processor -- start 2024-05-09T01:41:09.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f1e35557640 1 -- start start 2024-05-09T01:41:09.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7feefbfff640 1 -- 172.21.15.42:0/480272774 >> v2:172.21.15.181:3300/0 conn(0x7fef04161310 msgr2=0x7fef04161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7feefbfff640 1 --2- 172.21.15.42:0/480272774 >> v2:172.21.15.181:3300/0 conn(0x7fef04161310 0x7fef04161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7feefbfff640 1 -- 172.21.15.42:0/480272774 >> v1:172.21.15.181:6789/0 conn(0x7fef040cc070 legacy=0x7fef040cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7feefbfff640 1 -- 172.21.15.42:0/480272774 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0406e5f0 con 0x7fef04071b00 2024-05-09T01:41:09.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7fef037fe640 1 --2- 172.21.15.42:0/480272774 >> v2:172.21.15.181:3300/0 conn(0x7fef04161310 0x7fef04161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:09.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe440aa070 con 0x7fbe3c1004e0 2024-05-09T01:41:09.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe440a5410 con 0x7fbe3c1004e0 2024-05-09T01:41:09.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7fbe42ffd640 1 -- 172.21.15.42:0/2631649576 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44050de0 con 0x7fbe3c1004e0 2024-05-09T01:41:09.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.755+0000 7f0bbfa27640 1 -- start start 2024-05-09T01:41:09.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f0bbfa27640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0bb00e3700 0x7f0bb0045800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f0bbfa27640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0bb004b720 0x7f0bb004bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f0bbfa27640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb00062f0 con 0x7f0bb0007650 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f0bbfa27640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb00060c0 con 0x7f0bb00e3700 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.757+0000 7f0bbfa27640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb00071c0 con 0x7f0bb004b720 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f0bbd7c3640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0bb0007650 0x7f0bb00dd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42908/0 (socket says 172.21.15.42:42908) 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f0bbd7c3640 1 -- 172.21.15.42:0/2868918039 learned_addr learned my addr 172.21.15.42:0/2868918039 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2868918039 >> v2:172.21.15.181:3300/0 conn(0x7f0bb004b720 0x7f0bb004bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f69c6234640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f69b80d9830 0x7f69b80073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963255312 0 0) 0x7f0bb00062f0 con 0x7f0bb0007650 2024-05-09T01:41:09.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7feefbfff640 1 --2- 172.21.15.42:0/480272774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04071b00 0x7fef040ca7b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef040cd7e0 tx=0x7feeec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf57a59bc922dd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba4003520 con 0x7f0bb0007650 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe49710640 1 -- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 msgr2=0x7fbe34003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe49710640 1 --2- 172.21.15.42:0/2631649576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c1004e0 0x7fbe34003bc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe44051620 tx=0x7fbe34003890 comp rx=0 tx=0).stop 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe48f0f640 1 -- 172.21.15.42:0/2631649576 reap_dead start 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f69c6234640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b80dfee0 con 0x7f69b804b2e0 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f69c5232640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f69b80d9830 0x7f69b80073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f69c5232640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f69b80d9830 0x7f69b80073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35638/0 (socket says 172.21.15.42:35638) 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f69c4a31640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f69b8050ab0 0x7f69b804abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42924/0 (socket says 172.21.15.42:42924) 2024-05-09T01:41:09.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f69c5232640 1 -- 172.21.15.42:0/481948543 learned_addr learned my addr 172.21.15.42:0/481948543 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fef027fc640 1 -- 172.21.15.42:0/480272774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec037070 con 0x7fef04071b00 2024-05-09T01:41:09.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe49710640 1 -- 172.21.15.42:0/2631649576 shutdown_connections 2024-05-09T01:41:09.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe49710640 1 -- 172.21.15.42:0/2631649576 >> 172.21.15.42:0/2631649576 conn(0x7fbe3c0503a0 msgr2=0x7fbe3c0507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2868918039 >> v2:172.21.15.42:3300/0 conn(0x7f0bb00e3700 0x7f0bb0045800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109427895 0 0) 0x7f0ba4003520 con 0x7f0bb0007650 2024-05-09T01:41:09.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe49710640 1 -- 172.21.15.42:0/2631649576 shutdown_connections 2024-05-09T01:41:09.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fbe49710640 1 -- 172.21.15.42:0/2631649576 wait complete. 2024-05-09T01:41:09.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.758+0000 7f69c5a33640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f69b804b2e0 0x7f69b80e9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50384/0 (socket says 172.21.15.42:50384) 2024-05-09T01:41:09.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 >> v2:172.21.15.181:3300/0 conn(0x7f0bb004b720 msgr2=0x7f0bb004bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fef027fc640 1 -- 172.21.15.42:0/480272774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec032440 con 0x7fef04071b00 2024-05-09T01:41:09.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7fef027fc640 1 -- 172.21.15.42:0/480272774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec032810 con 0x7fef04071b00 2024-05-09T01:41:09.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f166559a640 1 -- 172.21.15.42:0/3117632321 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565787463 0 0) 0x7f1658001110 con 0x7f1668073930 2024-05-09T01:41:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f166559a640 1 -- 172.21.15.42:0/3117632321 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1650003520 con 0x7f1668073930 2024-05-09T01:41:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b8049fd0 con 0x7f69b8050ab0 2024-05-09T01:41:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f69b80e0180 con 0x7f69b80d9830 2024-05-09T01:41:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f1666d9d640 1 -- 172.21.15.42:0/3117632321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16680ca350 msgr2=0x7f166815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f1666d9d640 1 --2- 172.21.15.42:0/3117632321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16680ca350 0x7f166815b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f1666d9d640 1 -- 172.21.15.42:0/3117632321 >> v1:172.21.15.42:6789/0 conn(0x7f1668073930 legacy=0x7f166806c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.759+0000 7f166559a640 1 -- 172.21.15.42:0/3117632321 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2995737344 0 0) 0x7f1650003520 con 0x7f1668073930 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1666d9d640 1 -- 172.21.15.42:0/3117632321 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16680745c0 con 0x7f166815b580 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e35557640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 0x7f1e301552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0baffff640 1 --2- 172.21.15.42:0/2868918039 >> v2:172.21.15.181:3300/0 conn(0x7f0bb004b720 0x7f0bb004bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 >> v2:172.21.15.42:3300/0 conn(0x7f0bb00e3700 msgr2=0x7f0bb0045800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0baffff640 1 --2- 172.21.15.42:0/2868918039 >> v2:172.21.15.42:3300/0 conn(0x7f0bb00e3700 0x7f0bb0045800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb00065b0 con 0x7f0bb0007650 2024-05-09T01:41:09.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f69b7fff640 1 -- 172.21.15.42:0/481948543 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253362246 0 0) 0x7f69b80dfee0 con 0x7f69b804b2e0 2024-05-09T01:41:09.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f69b7fff640 1 -- 172.21.15.42:0/481948543 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69ac003520 con 0x7f69b804b2e0 2024-05-09T01:41:09.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f69b7fff640 1 -- 172.21.15.42:0/481948543 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121579431 0 0) 0x7f69b8049fd0 con 0x7f69b8050ab0 2024-05-09T01:41:09.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f69c5232640 1 -- 172.21.15.42:0/481948543 >> v1:172.21.15.181:6789/0 conn(0x7f69b8050ab0 legacy=0x7f69b804abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2868918039 >> v2:172.21.15.42:3300/0 conn(0x7f0bb00e3700 0x7f0bb0045800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:09.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f69c5232640 1 -- 172.21.15.42:0/481948543 >> v1:172.21.15.42:6789/0 conn(0x7f69b804b2e0 legacy=0x7f69b80e9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2868918039 >> v2:172.21.15.181:3300/0 conn(0x7f0bb004b720 0x7f0bb004bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:09.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f69c5232640 1 -- 172.21.15.42:0/481948543 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b804a6b0 con 0x7f69b80d9830 2024-05-09T01:41:09.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f0ba8001710 con 0x7f0bb0007650 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e35557640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 0x7f1e30160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e35557640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30161200 0x7f1e3014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e2effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 0x7f1e301552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e2effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 0x7f1e301552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60652/0 (socket says 172.21.15.42:60652) 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e2effd640 1 -- 172.21.15.42:0/264859378 learned_addr learned my addr 172.21.15.42:0/264859378 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e300c9430 con 0x7f1e30161200 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e300c9150 con 0x7f1e30070600 2024-05-09T01:41:09.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3015b8a0 con 0x7f1e3015b490 2024-05-09T01:41:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7fef03fff640 1 -- 172.21.15.42:0/480272774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04071b00 msgr2=0x7fef040ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e2effd640 1 -- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 msgr2=0x7f1e30160070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:41:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e2effd640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 0x7f1e30160070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e2effd640 1 -- 172.21.15.42:0/264859378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30161200 msgr2=0x7f1e3014c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e2effd640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30161200 0x7f1e3014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e2effd640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e301e7710 con 0x7f1e30070600 2024-05-09T01:41:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.760+0000 7fef03fff640 1 --2- 172.21.15.42:0/480272774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04071b00 0x7fef040ca7b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef040cd7e0 tx=0x7feeec02a230 comp rx=0 tx=0).stop 2024-05-09T01:41:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 >> v1:172.21.15.181:6789/0 conn(0x7f0bb0007650 legacy=0x7f0bb00dd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7fef03fff640 1 -- 172.21.15.42:0/480272774 shutdown_connections 2024-05-09T01:41:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7fef03fff640 1 --2- 172.21.15.42:0/480272774 >> v2:172.21.15.181:3300/0 conn(0x7fef04161310 0x7fef04161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7fef03fff640 1 --2- 172.21.15.42:0/480272774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04071b00 0x7fef040ca7b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7fef03fff640 1 -- 172.21.15.42:0/480272774 >> 172.21.15.42:0/480272774 conn(0x7fef04068a30 msgr2=0x7fef04068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e2effd640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 0x7f1e301552b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000c730 tx=0x7f1e2000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1666d9d640 1 --2- 172.21.15.42:0/3117632321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f16681654c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f165c0097a0 tx=0x7f165c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c6e63c9f513194 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f0baffff640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba4003aa0 0x7f0ba4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f0baffff640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0ba4004800 0x7f0ba4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbd7c3640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba4003aa0 0x7f0ba4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0baffff640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ba40052a0 0x7f0ba400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20017070 con 0x7f1e30070600 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e20005290 con 0x7f1e30070600 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000a880 con 0x7f1e30070600 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e301e79d0 con 0x7f1e30070600 2024-05-09T01:41:09.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f69c5232640 1 --2- 172.21.15.42:0/481948543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80d9830 0x7f69b80073b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009870 tx=0x7f69b002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3106bd9b9efa1709 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7f166559a640 1 -- 172.21.15.42:0/3117632321 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c037070 con 0x7f166815b580 2024-05-09T01:41:09.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f166559a640 1 -- 172.21.15.42:0/3117632321 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c02ac30 con 0x7f166815b580 2024-05-09T01:41:09.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f166559a640 1 -- 172.21.15.42:0/3117632321 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16580018c0 con 0x7f166815b580 2024-05-09T01:41:09.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.761+0000 7fbe49710640 1 Processor -- start 2024-05-09T01:41:09.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb00071c0 con 0x7f0ba40052a0 2024-05-09T01:41:09.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ba40052a0 0x7f0ba400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301e8700 con 0x7f1e30070600 2024-05-09T01:41:09.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba400c220 con 0x7f0ba4003aa0 2024-05-09T01:41:09.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba400c420 con 0x7f0ba4004800 2024-05-09T01:41:09.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0ba4004800 0x7f0ba4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7fbe49710640 1 -- start start 2024-05-09T01:41:09.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f69b7fff640 1 -- 172.21.15.42:0/481948543 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0037070 con 0x7f69b80d9830 2024-05-09T01:41:09.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbdfc4640 1 -- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0ba4004800 msgr2=0x7f0ba4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0ba4004800 0x7f0ba4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbdfc4640 1 -- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba4003aa0 msgr2=0x7f0ba4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:09.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba4003aa0 0x7f0ba4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f0bbdfc4640 1 -- 172.21.15.42:0/2868918039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba4003520 con 0x7f0ba40052a0 2024-05-09T01:41:09.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.762+0000 7f69b7fff640 1 -- 172.21.15.42:0/481948543 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b0032640 con 0x7f69b80d9830 2024-05-09T01:41:09.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.763+0000 7fef03fff640 1 -- 172.21.15.42:0/480272774 shutdown_connections 2024-05-09T01:41:09.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.763+0000 7f0bbdfc4640 1 -- 172.21.15.42:0/2868918039 reap_dead start 2024-05-09T01:41:09.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.763+0000 7f69b7fff640 1 -- 172.21.15.42:0/481948543 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00329f0 con 0x7f69b80d9830 2024-05-09T01:41:09.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ba40052a0 0x7f0ba400b9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0bb806bcd0 tx=0x7f0ba4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6dbf7274b35ca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.763+0000 7fef03fff640 1 -- 172.21.15.42:0/480272774 wait complete. 2024-05-09T01:41:09.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7fbe49710640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 0x7fbe3c0ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f166cb76640 1 -- 172.21.15.42:0/3117632321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 msgr2=0x7f16681654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f166cb76640 1 --2- 172.21.15.42:0/3117632321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f16681654c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f165c0097a0 tx=0x7f165c02a1a0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80d9830 msgr2=0x7f69b80073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80b5070 con 0x7f0ba40052a0 2024-05-09T01:41:09.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f69c6234640 1 --2- 172.21.15.42:0/481948543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80d9830 0x7f69b80073b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009870 tx=0x7f69b002a320 comp rx=0 tx=0).stop 2024-05-09T01:41:09.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb80a8d70 con 0x7f0ba40052a0 2024-05-09T01:41:09.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 shutdown_connections 2024-05-09T01:41:09.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f69c6234640 1 --2- 172.21.15.42:0/481948543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80d9830 0x7f69b80073b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 >> 172.21.15.42:0/481948543 conn(0x7f69b800e360 msgr2=0x7f69b800e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f0baffff640 1 -- 172.21.15.42:0/2868918039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8064120 con 0x7f0ba40052a0 2024-05-09T01:41:09.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7fbe43fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 0x7fbe3c0ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7fbe43fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 0x7fbe3c0ff8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35672/0 (socket says 172.21.15.42:35672) 2024-05-09T01:41:09.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7fbe43fff640 1 -- 172.21.15.42:0/3673568674 learned_addr learned my addr 172.21.15.42:0/3673568674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe3c0f6690 0x7fbe3c0f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 shutdown_connections 2024-05-09T01:41:09.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.764+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c0fe0b0 0x7fbe3c0f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7fbe437fe640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe3c0f6690 0x7fbe3c0f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f69c6234640 1 -- 172.21.15.42:0/481948543 wait complete. 2024-05-09T01:41:09.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7fbe48f0f640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c0fe0b0 0x7fbe3c0f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c006aa0 con 0x7fbe3c1004e0 2024-05-09T01:41:09.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c0067c0 con 0x7fbe3c0f6690 2024-05-09T01:41:09.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c045c00 con 0x7fbe3c0fe0b0 2024-05-09T01:41:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2868918039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ba40052a0 msgr2=0x7f0ba400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f0bbfa27640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ba40052a0 0x7f0ba400b9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0bb806bcd0 tx=0x7f0ba4005830 comp rx=0 tx=0).stop 2024-05-09T01:41:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2868918039 shutdown_connections 2024-05-09T01:41:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f0bbfa27640 1 --2- 172.21.15.42:0/2868918039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ba40052a0 0x7f0ba400b9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2868918039 >> 172.21.15.42:0/2868918039 conn(0x7f0bb00503e0 msgr2=0x7f0bb00507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e300c5670 con 0x7f1e30070600 2024-05-09T01:41:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.765+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2868918039 shutdown_connections 2024-05-09T01:41:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f166cb76640 1 -- 172.21.15.42:0/3117632321 shutdown_connections 2024-05-09T01:41:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f166cb76640 1 --2- 172.21.15.42:0/3117632321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f16681654c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f166cb76640 1 --2- 172.21.15.42:0/3117632321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16680ca350 0x7f166815b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f166cb76640 1 -- 172.21.15.42:0/3117632321 >> 172.21.15.42:0/3117632321 conn(0x7f166806dba0 msgr2=0x7f166806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:09.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2868918039 wait complete. 2024-05-09T01:41:09.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f166cb76640 1 -- 172.21.15.42:0/3117632321 shutdown_connections 2024-05-09T01:41:09.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7f166cb76640 1 -- 172.21.15.42:0/3117632321 wait complete. 2024-05-09T01:41:09.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe43fff640 1 -- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c0fe0b0 msgr2=0x7fbe3c0f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fef03fff640 1 Processor -- start 2024-05-09T01:41:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fef03fff640 1 -- start start 2024-05-09T01:41:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe43fff640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c0fe0b0 0x7fbe3c0f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe43fff640 1 -- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe3c0f6690 msgr2=0x7fbe3c0f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe43fff640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe3c0f6690 0x7fbe3c0f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe43fff640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c1895a0 con 0x7fbe3c1004e0 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe437fe640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe3c0f6690 0x7fbe3c0f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.766+0000 7fbe43fff640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 0x7fbe3c0ff8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbe44052170 tx=0x7fbe4406acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.767+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe440b4070 con 0x7fbe3c1004e0 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.767+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe440a5db0 con 0x7fbe3c1004e0 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.767+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe440aa040 con 0x7fbe3c1004e0 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.767+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c100200 con 0x7fbe3c1004e0 2024-05-09T01:41:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.768+0000 7f69c6234640 1 Processor -- start 2024-05-09T01:41:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.768+0000 7f69c6234640 1 -- start start 2024-05-09T01:41:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.768+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3c188330 con 0x7fbe3c1004e0 2024-05-09T01:41:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.768+0000 7fef03fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef04071b00 0x7fef041eabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.768+0000 7fef03fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 0x7fef04163a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.768+0000 7fef03fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04161310 0x7fef04157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7f0bbfa27640 1 Processor -- start 2024-05-09T01:41:09.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7f0bbfa27640 1 -- start start 2024-05-09T01:41:09.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e2001a070 con 0x7f1e30070600 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7f166cb76640 1 Processor -- start 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7f166cb76640 1 -- start start 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7fef02ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef04071b00 0x7fef041eabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7fef02ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef04071b00 0x7fef041eabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:36554/0 (socket says 172.21.15.42:36554) 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7feefbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 0x7fef04163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7feefbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 0x7fef04163a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60684/0 (socket says 172.21.15.42:60684) 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7fef03fff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef040cc540 con 0x7fef04161310 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7fef03fff640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef0415b2e0 con 0x7fef040cc070 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7fef03fff640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fef040cc6c0 con 0x7fef04071b00 2024-05-09T01:41:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7fef02ffd640 1 -- 172.21.15.42:0/2746391994 learned_addr learned my addr 172.21.15.42:0/2746391994 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.769+0000 7f1e177fe640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1e1c0763a0 0x7f1e1c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7feefbfff640 1 -- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef04071b00 msgr2=0x7fef041eabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7feefbfff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef04071b00 0x7fef041eabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7feefbfff640 1 -- 172.21.15.42:0/2746391994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04161310 msgr2=0x7fef04157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7feefbfff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04161310 0x7fef04157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7feefbfff640 1 -- 172.21.15.42:0/2746391994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef041ebad0 con 0x7fef040cc070 2024-05-09T01:41:09.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e20096b60 con 0x7f1e30070600 2024-05-09T01:41:09.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7f69c6234640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69b8050ab0 0x7f69b80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7f69c6234640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69b80d9830 0x7f69b8053380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7f69c6234640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 0x7f69b80d5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.770+0000 7f69c6234640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69b800f390 con 0x7f69b80c9930 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 0x7f69b80d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 0x7f69b80d5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35686/0 (socket says 172.21.15.42:35686) 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 -- 172.21.15.42:0/2871003575 learned_addr learned my addr 172.21.15.42:0/2871003575 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f69b800f210 con 0x7f69b8050ab0 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f69b80495e0 con 0x7f69b80d9830 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe440b7070 con 0x7fbe3c1004e0 2024-05-09T01:41:09.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3c0fa910 con 0x7fbe3c1004e0 2024-05-09T01:41:09.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f1e2e7fc640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1e1c0763a0 0x7f1e1c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7feefbfff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 0x7fef04163a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef040d0eb0 tx=0x7feeec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 -- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69b80d9830 msgr2=0x7f69b8053380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:41:09.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69b80d9830 0x7f69b8053380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 -- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69b8050ab0 msgr2=0x7f69b80ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69b8050ab0 0x7f69b80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f69c5a33640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b80538c0 con 0x7f69b80c9930 2024-05-09T01:41:09.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec041030 con 0x7fef040cc070 2024-05-09T01:41:09.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7f0bbfa27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 0x7f0bb0035070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec030500 con 0x7fef040cc070 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.771+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec037040 con 0x7fef040cc070 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbfa27640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bb00494f0 0x7f0bb0049900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbfa27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb00e5150 0x7f0bb00e5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbfa27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0006e50 con 0x7f0bb00e5150 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbfa27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0006b70 con 0x7f0ba40052a0 2024-05-09T01:41:09.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbfa27640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb0047410 con 0x7f0bb00494f0 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef04072df0 con 0x7fef040cc070 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef041fa9f0 con 0x7fef040cc070 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f69c5a33640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 0x7f69b80d5580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c3f0 tx=0x7f69bc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f166cb76640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1668073930 0x7f1668156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f166cb76640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16680ca350 0x7f166814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f166659c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1668073930 0x7f1668156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f166659c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1668073930 0x7f1668156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:36582/0 (socket says 172.21.15.42:36582) 2024-05-09T01:41:09.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7fbe40ff9640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbe28076350 0x7fbe28078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbe44128160 con 0x7fbe3c1004e0 2024-05-09T01:41:09.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f166659c640 1 -- 172.21.15.42:0/2850978652 learned_addr learned my addr 172.21.15.42:0/2850978652 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbd7c3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 0x7f0bb0035070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f1668145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbd7c3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 0x7f0bb0035070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60696/0 (socket says 172.21.15.42:60696) 2024-05-09T01:41:09.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbd7c3640 1 -- 172.21.15.42:0/2501593669 learned_addr learned my addr 172.21.15.42:0/2501593669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:09.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1e20060410 con 0x7f1e30070600 2024-05-09T01:41:09.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f1665d9b640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16680ca350 0x7f166814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.772+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bb00494f0 0x7f0bb0049900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1666d9d640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f1668145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f166815b990 con 0x7f166815b580 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1668074b80 con 0x7f16680ca350 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f166806d4f0 con 0x7f1668073930 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb00e5150 0x7f0bb00e5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbd7c3640 1 -- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bb00494f0 msgr2=0x7f0bb0049900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbd7c3640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bb00494f0 0x7f0bb0049900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbd7c3640 1 -- 172.21.15.42:0/2501593669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb00e5150 msgr2=0x7f0bb00e5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbd7c3640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb00e5150 0x7f0bb00e5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbd7c3640 1 -- 172.21.15.42:0/2501593669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb00355b0 con 0x7f0ba40052a0 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbdfc4640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb00e5150 0x7f0bb00e5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bb00494f0 0x7f0bb0049900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0bbd7c3640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 0x7f0bb0035070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800e760 tx=0x7f0ba800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef041fa520 con 0x7fef040cc070 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1665d9b640 1 -- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1668073930 msgr2=0x7f1668156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1665d9b640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1668073930 0x7f1668156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1665d9b640 1 -- 172.21.15.42:0/2850978652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 msgr2=0x7f1668145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1665d9b640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f1668145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1665d9b640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1668156ba0 con 0x7f16680ca350 2024-05-09T01:41:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7fbe437fe640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbe28076350 0x7fbe28078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f1e2e7fc640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1e1c0763a0 0x7f1e1c0788b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e301ebcc0 tx=0x7f1e28009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800c6c0 con 0x7f0ba40052a0 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.773+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8018070 con 0x7f0ba40052a0 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800ca80 con 0x7f0ba40052a0 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2501593669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb00e7670 con 0x7f0ba40052a0 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f0bbfa27640 1 -- 172.21.15.42:0/2501593669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb0047840 con 0x7f0ba40052a0 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feeec044070 con 0x7fef040cc070 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.775+0000 7feefb7fe640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7feee4076300 0x7feee4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.775+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feeec0b77b0 con 0x7fef040cc070 2024-05-09T01:41:09.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.775+0000 7fef02ffd640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7feee4076300 0x7feee4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f1665d9b640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16680ca350 0x7f166814cc30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1660007de0 tx=0x7f166000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660014420 con 0x7f16680ca350 2024-05-09T01:41:09.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1660019070 con 0x7f16680ca350 2024-05-09T01:41:09.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.774+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600147e0 con 0x7f16680ca350 2024-05-09T01:41:09.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.775+0000 7fbe437fe640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbe28076350 0x7fbe28078860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0f3050 tx=0x7fbe30001c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.775+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681488f0 con 0x7f16680ca350 2024-05-09T01:41:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.776+0000 7fef02ffd640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7feee4076300 0x7feee4078810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feef4005880 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.776+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1668149170 con 0x7f16680ca350 2024-05-09T01:41:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.776+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb00e7400 con 0x7f0ba40052a0 2024-05-09T01:41:09.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.776+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ba800cc20 con 0x7f0ba40052a0 2024-05-09T01:41:09.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.777+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16680cfad0 con 0x7f16680ca350 2024-05-09T01:41:09.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.777+0000 7f0badffb640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b9c0763a0 0x7f0b9c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.777+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ba8097330 con 0x7f0ba40052a0 2024-05-09T01:41:09.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.777+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b9c0763a0 0x7f0b9c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.778+0000 7f0bbcfc2640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b9c0763a0 0x7f0b9c0788b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0033150 tx=0x7f0bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0074e0 con 0x7f69b80c9930 2024-05-09T01:41:09.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc007680 con 0x7f69b80c9930 2024-05-09T01:41:09.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b80d5ac0 con 0x7f69b80c9930 2024-05-09T01:41:09.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe440f1400 con 0x7fbe3c1004e0 2024-05-09T01:41:09.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0049e0 con 0x7f69b80c9930 2024-05-09T01:41:09.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feeec080fe0 con 0x7fef040cc070 2024-05-09T01:41:09.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.780+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b80528a0 con 0x7f69b80c9930 2024-05-09T01:41:09.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.782+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1660014980 con 0x7f16680ca350 2024-05-09T01:41:09.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.783+0000 7f1656ffd640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1648076350 0x7f1648078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.784+0000 7f166659c640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1648076350 0x7f1648078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.785+0000 7f166659c640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1648076350 0x7f1648078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1658005880 tx=0x7f1658016040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.785+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69bc01a020 con 0x7f69b80c9930 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.786+0000 7f69b5ffb640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69a40763d0 0x7f69a40788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.787+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69bc096c30 con 0x7f69b80c9930 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.787+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b8006b40 con 0x7f69b80c9930 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.787+0000 7f69c5232640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69a40763d0 0x7f69a40788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.787+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ba8060c70 con 0x7f0ba40052a0 2024-05-09T01:41:09.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.794+0000 7f69c5232640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69a40763d0 0x7f69a40788e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69b0034000 tx=0x7f69b002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:09.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.797+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f166005e160 con 0x7f16680ca350 2024-05-09T01:41:09.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.797+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f16680cfad0 con 0x7f16680ca350 2024-05-09T01:41:09.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:09.805+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f69bc060600 con 0x7f69b80c9930 2024-05-09T01:41:10.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.147+0000 7fbeedffb640 1 -- 172.21.15.42:0/2176773736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbee0005850 con 0x7fbf000e3350 2024-05-09T01:41:10.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.148+0000 7fbeeffff640 1 -- 172.21.15.42:0/2176773736 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf080dcf70 con 0x7fbf000e3350 2024-05-09T01:41:10.145 INFO:teuthology.orchestra.run.smithi042.stdout:60129542152 2024-05-09T01:41:10.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.151+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbef4076350 msgr2=0x7fbef4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.151+0000 7fbf07fff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbef4076350 0x7fbef4078860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbefc006fd0 tx=0x7fbefc008040 comp rx=0 tx=0).stop 2024-05-09T01:41:10.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.151+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 msgr2=0x7fbf000d78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.151+0000 7fbf07fff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 0x7fbf000d78c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbf0806bcd0 tx=0x7fbf080755e0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 shutdown_connections 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbef4076350 0x7fbef4078860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf000e3350 0x7fbf000d78c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf000e79a0 0x7fbf000d7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 --2- 172.21.15.42:0/2176773736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf00046450 0x7fbf000deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 >> 172.21.15.42:0/2176773736 conn(0x7fbf00050800 msgr2=0x7fbf000d8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 shutdown_connections 2024-05-09T01:41:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.152+0000 7fbf07fff640 1 -- 172.21.15.42:0/2176773736 wait complete. 2024-05-09T01:41:10.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2024-05-09T01:41:10.167 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.171+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6ee4005850 con 0x7f6f040cc710 2024-05-09T01:41:10.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.172+0000 7f6f017fa640 1 -- 172.21.15.42:0/1450224084 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f041ef970 con 0x7f6f040cc710 2024-05-09T01:41:10.169 INFO:teuthology.orchestra.run.smithi042.stdout:60129542153 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.175+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6ef00766d0 msgr2=0x7f6ef0078be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.175+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6ef00766d0 0x7f6ef0078be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009aa0 tx=0x7f6efc009190 comp rx=0 tx=0).stop 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 msgr2=0x7f6f04153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 0x7f6f04153c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800b3c0 tx=0x7f6ef800b880 comp rx=0 tx=0).stop 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 shutdown_connections 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6ef00766d0 0x7f6ef0078be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f041634d0 0x7f6f04152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040cc710 0x7f6f04153c40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 --2- 172.21.15.42:0/1450224084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f040cb2f0 0x7f6f040c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 >> 172.21.15.42:0/1450224084 conn(0x7f6f04072890 msgr2=0x7f6f040ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 shutdown_connections 2024-05-09T01:41:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.176+0000 7f6f0b061640 1 -- 172.21.15.42:0/1450224084 wait complete. 2024-05-09T01:41:10.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2024-05-09T01:41:10.191 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.195+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fef0406a500 con 0x7fef040cc070 2024-05-09T01:41:10.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.195+0000 7feefb7fe640 1 -- 172.21.15.42:0/2746391994 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feeec0808e0 con 0x7fef040cc070 2024-05-09T01:41:10.193 INFO:teuthology.orchestra.run.smithi042.stdout:60129542151 2024-05-09T01:41:10.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7feee4076300 msgr2=0x7feee4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7feee4076300 0x7feee4078810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feef4005880 tx=0x7feef4009040 comp rx=0 tx=0).stop 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 msgr2=0x7fef04163a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 0x7fef04163a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef040d0eb0 tx=0x7feeec0046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 shutdown_connections 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7feee4076300 0x7feee4078810 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef04161310 0x7fef04157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef040cc070 0x7fef04163a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 --2- 172.21.15.42:0/2746391994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef04071b00 0x7fef041eabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 >> 172.21.15.42:0/2746391994 conn(0x7fef04068a30 msgr2=0x7fef040cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 shutdown_connections 2024-05-09T01:41:10.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.198+0000 7fef03fff640 1 -- 172.21.15.42:0/2746391994 wait complete. 2024-05-09T01:41:10.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-05-09T01:41:10.207 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.214+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0bb00349d0 con 0x7f0ba40052a0 2024-05-09T01:41:10.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.214+0000 7f0badffb640 1 -- 172.21.15.42:0/2501593669 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ba8060570 con 0x7f0ba40052a0 2024-05-09T01:41:10.212 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b9c0763a0 msgr2=0x7f0b9c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b9c0763a0 0x7f0b9c0788b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0033150 tx=0x7f0bb4008040 comp rx=0 tx=0).stop 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 msgr2=0x7f0bb0035070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 0x7f0bb0035070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800e760 tx=0x7f0ba800ec20 comp rx=0 tx=0).stop 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 shutdown_connections 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b9c0763a0 0x7f0b9c0788b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bb00e5150 0x7f0bb00e5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bb00494f0 0x7f0bb0049900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 --2- 172.21.15.42:0/2501593669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ba40052a0 0x7f0bb0035070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 >> 172.21.15.42:0/2501593669 conn(0x7f0bb00503e0 msgr2=0x7f0bb00057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 shutdown_connections 2024-05-09T01:41:10.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.217+0000 7f0b9b7fe640 1 -- 172.21.15.42:0/2501593669 wait complete. 2024-05-09T01:41:10.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-05-09T01:41:10.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.228+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1e301583e0 con 0x7f1e30070600 2024-05-09T01:41:10.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.229+0000 7f1e177fe640 1 -- 172.21.15.42:0/264859378 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e2005fd10 con 0x7f1e30070600 2024-05-09T01:41:10.226 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.226 INFO:teuthology.orchestra.run.smithi042.stdout:60129542151 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1e1c0763a0 msgr2=0x7f1e1c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1e1c0763a0 0x7f1e1c0788b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e301ebcc0 tx=0x7f1e28009250 comp rx=0 tx=0).stop 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 msgr2=0x7f1e301552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 0x7f1e301552b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000c730 tx=0x7f1e2000cbf0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 shutdown_connections 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1e1c0763a0 0x7f1e1c0788b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e30161200 0x7f1e3014c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e3015b490 0x7f1e30160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 --2- 172.21.15.42:0/264859378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e30070600 0x7f1e301552b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 >> 172.21.15.42:0/264859378 conn(0x7f1e3006cdc0 msgr2=0x7f1e300ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 shutdown_connections 2024-05-09T01:41:10.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.231+0000 7f1e35557640 1 -- 172.21.15.42:0/264859378 wait complete. 2024-05-09T01:41:10.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.240+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1668159d70 con 0x7f16680ca350 2024-05-09T01:41:10.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.241+0000 7f1656ffd640 1 -- 172.21.15.42:0/2850978652 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1668159d70 con 0x7f16680ca350 2024-05-09T01:41:10.238 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-05-09T01:41:10.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-05-09T01:41:10.241 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1648076350 msgr2=0x7f1648078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1648076350 0x7f1648078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1658005880 tx=0x7f1658016040 comp rx=0 tx=0).stop 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16680ca350 msgr2=0x7f166814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16680ca350 0x7f166814cc30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1660007de0 tx=0x7f166000e4b0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 shutdown_connections 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1648076350 0x7f1648078860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f166815b580 0x7f1668145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16680ca350 0x7f166814cc30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 --2- 172.21.15.42:0/2850978652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1668073930 0x7f1668156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 >> 172.21.15.42:0/2850978652 conn(0x7f166806dba0 msgr2=0x7f16681589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 shutdown_connections 2024-05-09T01:41:10.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.243+0000 7f166cb76640 1 -- 172.21.15.42:0/2850978652 wait complete. 2024-05-09T01:41:10.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-05-09T01:41:10.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.254+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbe3c04c690 con 0x7fbe3c1004e0 2024-05-09T01:41:10.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.254+0000 7fbe40ff9640 1 -- 172.21.15.42:0/3673568674 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe440f5700 con 0x7fbe3c1004e0 2024-05-09T01:41:10.252 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.252 INFO:teuthology.orchestra.run.smithi042.stdout:55834574855 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbe28076350 msgr2=0x7fbe28078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbe28076350 0x7fbe28078860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0f3050 tx=0x7fbe30001c00 comp rx=0 tx=0).stop 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 msgr2=0x7fbe3c0ff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 0x7fbe3c0ff8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbe44052170 tx=0x7fbe4406acb0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 shutdown_connections 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbe28076350 0x7fbe28078860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe3c0fe0b0 0x7fbe3c0f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe3c0f6690 0x7fbe3c0f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 --2- 172.21.15.42:0/3673568674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c1004e0 0x7fbe3c0ff8e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.257+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 >> 172.21.15.42:0/3673568674 conn(0x7fbe3c0503a0 msgr2=0x7fbe3c0349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.258+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 shutdown_connections 2024-05-09T01:41:10.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.258+0000 7fbe49710640 1 -- 172.21.15.42:0/3673568674 wait complete. 2024-05-09T01:41:10.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.259+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f69b8039e70 con 0x7f69b80c9930 2024-05-09T01:41:10.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.260+0000 7f69b5ffb640 1 -- 172.21.15.42:0/2871003575 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f69bc05ff00 con 0x7f69b80c9930 2024-05-09T01:41:10.257 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69a40763d0 msgr2=0x7f69a40788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69a40763d0 0x7f69a40788e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69b0034000 tx=0x7f69b002c000 comp rx=0 tx=0).stop 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 msgr2=0x7f69b80d5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 0x7f69b80d5580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c3f0 tx=0x7f69bc00c8b0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 shutdown_connections 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f69a40763d0 0x7f69a40788e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69b80c9930 0x7f69b80d5580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69b80d9830 0x7f69b8053380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 --2- 172.21.15.42:0/2871003575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69b8050ab0 0x7f69b80ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 >> 172.21.15.42:0/2871003575 conn(0x7f69b800e360 msgr2=0x7f69b804ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 shutdown_connections 2024-05-09T01:41:10.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.262+0000 7f69c6234640 1 -- 172.21.15.42:0/2871003575 wait complete. 2024-05-09T01:41:10.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-05-09T01:41:10.268 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-05-09T01:41:10.271 DEBUG:teuthology.parallel:result is None 2024-05-09T01:41:10.271 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T01:41:10.271 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:10.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.428+0000 7fa22636c640 1 Processor -- start 2024-05-09T01:41:10.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.428+0000 7fa22636c640 1 -- start start 2024-05-09T01:41:10.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa22636c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2200cdaa0 0x7fa220157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa22636c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa2200ce4e0 0x7fa2200ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa22636c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2200c7bf0 con 0x7fa2200ce0d0 2024-05-09T01:41:10.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa22636c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa2200ce8f0 con 0x7fa2200cdaa0 2024-05-09T01:41:10.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa22636c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa2200c79a0 con 0x7fa2200ce4e0 2024-05-09T01:41:10.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa21ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2200cdaa0 0x7fa220157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa21f7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa2200ce0d0 0x7fa220160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50392/0 (socket says 172.21.15.42:50392) 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa21f7fe640 1 -- 172.21.15.42:0/2909224402 learned_addr learned my addr 172.21.15.42:0/2909224402 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.429+0000 7fa224909640 1 --2- 172.21.15.42:0/2909224402 >> v2:172.21.15.181:3300/0 conn(0x7fa2200ce4e0 0x7fa2200ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.430+0000 7fa21ffff640 1 -- 172.21.15.42:0/2909224402 >> v2:172.21.15.181:3300/0 conn(0x7fa2200ce4e0 msgr2=0x7fa2200ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.430+0000 7fa21ffff640 1 --2- 172.21.15.42:0/2909224402 >> v2:172.21.15.181:3300/0 conn(0x7fa2200ce4e0 0x7fa2200ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.430+0000 7fa21ffff640 1 -- 172.21.15.42:0/2909224402 >> v1:172.21.15.42:6789/0 conn(0x7fa2200ce0d0 legacy=0x7fa220160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.430+0000 7fa21ffff640 1 -- 172.21.15.42:0/2909224402 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2200c7ed0 con 0x7fa2200cdaa0 2024-05-09T01:41:10.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.430+0000 7fa21ffff640 1 --2- 172.21.15.42:0/2909224402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200cdaa0 0x7fa220157100 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2200900d0 tx=0x7fa21002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b0955c6f7a377b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:10.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa21effd640 1 -- 172.21.15.42:0/2909224402 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210037070 con 0x7fa2200cdaa0 2024-05-09T01:41:10.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa21effd640 1 -- 172.21.15.42:0/2909224402 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa210032440 con 0x7fa2200cdaa0 2024-05-09T01:41:10.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa21effd640 1 -- 172.21.15.42:0/2909224402 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210032810 con 0x7fa2200cdaa0 2024-05-09T01:41:10.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 -- 172.21.15.42:0/2909224402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200cdaa0 msgr2=0x7fa220157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 --2- 172.21.15.42:0/2909224402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200cdaa0 0x7fa220157100 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2200900d0 tx=0x7fa21002a1a0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 -- 172.21.15.42:0/2909224402 shutdown_connections 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 --2- 172.21.15.42:0/2909224402 >> v2:172.21.15.181:3300/0 conn(0x7fa2200ce4e0 0x7fa2200ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 --2- 172.21.15.42:0/2909224402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200cdaa0 0x7fa220157100 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 -- 172.21.15.42:0/2909224402 >> 172.21.15.42:0/2909224402 conn(0x7fa220068610 msgr2=0x7fa220068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 -- 172.21.15.42:0/2909224402 shutdown_connections 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.431+0000 7fa22636c640 1 -- 172.21.15.42:0/2909224402 wait complete. 2024-05-09T01:41:10.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.433+0000 7fa22636c640 1 Processor -- start 2024-05-09T01:41:10.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.433+0000 7fa22636c640 1 -- start start 2024-05-09T01:41:10.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.434+0000 7fa22636c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2200cdaa0 0x7fa2201f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa22636c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2200ce0d0 0x7fa2200d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa22636c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 0x7fa22015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa22636c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa2200c8770 con 0x7fa2200ce4e0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa22636c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa2200c8490 con 0x7fa2200cdaa0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa22636c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa220160470 con 0x7fa2200ce0d0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 0x7fa22015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 0x7fa22015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35724/0 (socket says 172.21.15.42:35724) 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 -- 172.21.15.42:0/2790020054 learned_addr learned my addr 172.21.15.42:0/2790020054 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa21ffff640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2200cdaa0 0x7fa2201f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa21f7fe640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2200ce0d0 0x7fa2200d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 -- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2200ce0d0 msgr2=0x7fa2200d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2200ce0d0 0x7fa2200d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 -- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2200cdaa0 msgr2=0x7fa2201f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2200cdaa0 0x7fa2201f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 -- 172.21.15.42:0/2790020054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2201f3330 con 0x7fa2200ce4e0 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa21ffff640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2200cdaa0 0x7fa2201f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:10.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa224909640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 0x7fa22015cca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa21800efc0 tx=0x7fa21800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:10.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218018020 con 0x7fa2200ce4e0 2024-05-09T01:41:10.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218014480 con 0x7fa2200ce4e0 2024-05-09T01:41:10.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2200c9470 con 0x7fa2200ce4e0 2024-05-09T01:41:10.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.435+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218009e60 con 0x7fa2200ce4e0 2024-05-09T01:41:10.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.436+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2200d1a40 con 0x7fa2200ce4e0 2024-05-09T01:41:10.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.436+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2200c74e0 con 0x7fa2200ce4e0 2024-05-09T01:41:10.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.437+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa21801b020 con 0x7fa2200ce4e0 2024-05-09T01:41:10.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.438+0000 7fa21cff9640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa20c0762d0 0x7fa20c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.438+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa2180981f0 con 0x7fa2200ce4e0 2024-05-09T01:41:10.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.438+0000 7fa21ffff640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa20c0762d0 0x7fa20c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.439+0000 7fa21ffff640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa20c0762d0 0x7fa20c0787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa210034000 tx=0x7fa21002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:10.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.443+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa218022020 con 0x7fa2200ce4e0 2024-05-09T01:41:10.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.627+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2200cd880 con 0x7fa20c0762d0 2024-05-09T01:41:10.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.634+0000 7fa21cff9640 1 -- 172.21.15.42:0/2790020054 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7fa2200cd880 con 0x7fa20c0762d0 2024-05-09T01:41:10.634 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:10.635 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa20c0762d0 msgr2=0x7fa20c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa20c0762d0 0x7fa20c0787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa210034000 tx=0x7fa21002e000 comp rx=0 tx=0).stop 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 msgr2=0x7fa22015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 0x7fa22015cca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa21800efc0 tx=0x7fa21800c490 comp rx=0 tx=0).stop 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 shutdown_connections 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa20c0762d0 0x7fa20c0787e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2200ce4e0 0x7fa22015cca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2200ce0d0 0x7fa2200d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 --2- 172.21.15.42:0/2790020054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2200cdaa0 0x7fa2201f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 >> 172.21.15.42:0/2790020054 conn(0x7fa220068610 msgr2=0x7fa220154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 shutdown_connections 2024-05-09T01:41:10.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.637+0000 7fa22636c640 1 -- 172.21.15.42:0/2790020054 wait complete. 2024-05-09T01:41:10.646 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-09T01:41:10.215990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239784,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734936,"statfs":{"total":773094113280,"available":772848574464,"internally_reserved":0,"allocated":2924544,"data_stored":1773196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002757"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396949+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:41:01.396949+0000","last_peered":"2024-05-09T01:41:01.396949+0000","last_clean":"2024-05-09T01:41:01.396949+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:41:01.396949+0000","last_undegraded":"2024-05-09T01:41:01.396949+0000","last_fullsized":"2024-05-09T01:41:01.396949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397106+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:41:01.397106+0000","last_peered":"2024-05-09T01:41:01.397106+0000","last_clean":"2024-05-09T01:41:01.397106+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:41:01.397106+0000","last_undegraded":"2024-05-09T01:41:01.397106+0000","last_fullsized":"2024-05-09T01:41:01.397106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397038+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:41:01.397038+0000","last_peered":"2024-05-09T01:41:01.397038+0000","last_clean":"2024-05-09T01:41:01.397038+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:41:01.397038+0000","last_undegraded":"2024-05-09T01:41:01.397038+0000","last_fullsized":"2024-05-09T01:41:01.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396661+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:41:01.396661+0000","last_peered":"2024-05-09T01:41:01.396661+0000","last_clean":"2024-05-09T01:41:01.396661+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:41:01.396661+0000","last_undegraded":"2024-05-09T01:41:01.396661+0000","last_fullsized":"2024-05-09T01:41:01.396661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397057+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:41:01.397057+0000","last_peered":"2024-05-09T01:41:01.397057+0000","last_clean":"2024-05-09T01:41:01.397057+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:41:01.397057+0000","last_undegraded":"2024-05-09T01:41:01.397057+0000","last_fullsized":"2024-05-09T01:41:01.397057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396811+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:41:01.396811+0000","last_peered":"2024-05-09T01:41:01.396811+0000","last_clean":"2024-05-09T01:41:01.396811+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:41:01.396811+0000","last_undegraded":"2024-05-09T01:41:01.396811+0000","last_fullsized":"2024-05-09T01:41:01.396811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396364+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:41:01.396364+0000","last_peered":"2024-05-09T01:41:01.396364+0000","last_clean":"2024-05-09T01:41:01.396364+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:41:01.396364+0000","last_undegraded":"2024-05-09T01:41:01.396364+0000","last_fullsized":"2024-05-09T01:41:01.396364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:42.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396374+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:41:01.396374+0000","last_peered":"2024-05-09T01:41:01.396374+0000","last_clean":"2024-05-09T01:41:01.396374+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:41:01.396374+0000","last_undegraded":"2024-05-09T01:41:01.396374+0000","last_fullsized":"2024-05-09T01:41:01.396374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.222814+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:01.222814+0000","last_peered":"2024-05-09T01:41:01.222814+0000","last_clean":"2024-05-09T01:41:01.222814+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:01.222814+0000","last_undegraded":"2024-05-09T01:41:01.222814+0000","last_fullsized":"2024-05-09T01:41:01.222814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397053+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:41:01.397053+0000","last_peered":"2024-05-09T01:41:01.397053+0000","last_clean":"2024-05-09T01:41:01.397053+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:41:01.397053+0000","last_undegraded":"2024-05-09T01:41:01.397053+0000","last_fullsized":"2024-05-09T01:41:01.397053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:02.224327+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:02.224327+0000","last_peered":"2024-05-09T01:41:02.224327+0000","last_clean":"2024-05-09T01:41:02.224327+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:02.224327+0000","last_undegraded":"2024-05-09T01:41:02.224327+0000","last_fullsized":"2024-05-09T01:41:02.224327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738548+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:00.738548+0000","last_peered":"2024-05-09T01:41:00.738548+0000","last_clean":"2024-05-09T01:41:00.738548+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:00.738548+0000","last_undegraded":"2024-05-09T01:41:00.738548+0000","last_fullsized":"2024-05-09T01:41:00.738548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396872+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:01.396872+0000","last_peered":"2024-05-09T01:41:01.396872+0000","last_clean":"2024-05-09T01:41:01.396872+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:01.396872+0000","last_undegraded":"2024-05-09T01:41:01.396872+0000","last_fullsized":"2024-05-09T01:41:01.396872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337492+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:01.337492+0000","last_peered":"2024-05-09T01:41:01.337492+0000","last_clean":"2024-05-09T01:41:01.337492+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:01.337492+0000","last_undegraded":"2024-05-09T01:41:01.337492+0000","last_fullsized":"2024-05-09T01:41:01.337492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397065+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:01.397065+0000","last_peered":"2024-05-09T01:41:01.397065+0000","last_clean":"2024-05-09T01:41:01.397065+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:01.397065+0000","last_undegraded":"2024-05-09T01:41:01.397065+0000","last_fullsized":"2024-05-09T01:41:01.397065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396844+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:41:01.396844+0000","last_peered":"2024-05-09T01:41:01.396844+0000","last_clean":"2024-05-09T01:41:01.396844+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:41:01.396844+0000","last_undegraded":"2024-05-09T01:41:01.396844+0000","last_fullsized":"2024-05-09T01:41:01.396844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.746876+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:04.746876+0000","last_peered":"2024-05-09T01:41:04.746876+0000","last_clean":"2024-05-09T01:41:04.746876+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:04.746876+0000","last_undegraded":"2024-05-09T01:41:04.746876+0000","last_fullsized":"2024-05-09T01:41:04.746876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397303+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:41:01.397303+0000","last_peered":"2024-05-09T01:41:01.397303+0000","last_clean":"2024-05-09T01:41:01.397303+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:41:01.397303+0000","last_undegraded":"2024-05-09T01:41:01.397303+0000","last_fullsized":"2024-05-09T01:41:01.397303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.746344+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:04.746344+0000","last_peered":"2024-05-09T01:41:04.746344+0000","last_clean":"2024-05-09T01:41:04.746344+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:04.746344+0000","last_undegraded":"2024-05-09T01:41:04.746344+0000","last_fullsized":"2024-05-09T01:41:04.746344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.747048+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:04.747048+0000","last_peered":"2024-05-09T01:41:04.747048+0000","last_clean":"2024-05-09T01:41:04.747048+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:04.747048+0000","last_undegraded":"2024-05-09T01:41:04.747048+0000","last_fullsized":"2024-05-09T01:41:04.747048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397056+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:41:01.397056+0000","last_peered":"2024-05-09T01:41:01.397056+0000","last_clean":"2024-05-09T01:41:01.397056+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:41:01.397056+0000","last_undegraded":"2024-05-09T01:41:01.397056+0000","last_fullsized":"2024-05-09T01:41:01.397056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397392+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:01.397392+0000","last_peered":"2024-05-09T01:41:01.397392+0000","last_clean":"2024-05-09T01:41:01.397392+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:01.397392+0000","last_undegraded":"2024-05-09T01:41:01.397392+0000","last_fullsized":"2024-05-09T01:41:01.397392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337112+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:01.337112+0000","last_peered":"2024-05-09T01:41:01.337112+0000","last_clean":"2024-05-09T01:41:01.337112+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:01.337112+0000","last_undegraded":"2024-05-09T01:41:01.337112+0000","last_fullsized":"2024-05-09T01:41:01.337112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.746863+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:04.746863+0000","last_peered":"2024-05-09T01:41:04.746863+0000","last_clean":"2024-05-09T01:41:04.746863+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:04.746863+0000","last_undegraded":"2024-05-09T01:41:04.746863+0000","last_fullsized":"2024-05-09T01:41:04.746863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396653+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:01.396653+0000","last_peered":"2024-05-09T01:41:01.396653+0000","last_clean":"2024-05-09T01:41:01.396653+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:01.396653+0000","last_undegraded":"2024-05-09T01:41:01.396653+0000","last_fullsized":"2024-05-09T01:41:01.396653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744167+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:04.744167+0000","last_peered":"2024-05-09T01:41:04.744167+0000","last_clean":"2024-05-09T01:41:04.744167+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:04.744167+0000","last_undegraded":"2024-05-09T01:41:04.744167+0000","last_fullsized":"2024-05-09T01:41:04.744167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.225857+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:01.225857+0000","last_peered":"2024-05-09T01:41:01.225857+0000","last_clean":"2024-05-09T01:41:01.225857+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:01.225857+0000","last_undegraded":"2024-05-09T01:41:01.225857+0000","last_fullsized":"2024-05-09T01:41:01.225857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396682+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:01.396682+0000","last_peered":"2024-05-09T01:41:01.396682+0000","last_clean":"2024-05-09T01:41:01.396682+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:01.396682+0000","last_undegraded":"2024-05-09T01:41:01.396682+0000","last_fullsized":"2024-05-09T01:41:01.396682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397003+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:01.397003+0000","last_peered":"2024-05-09T01:41:01.397003+0000","last_clean":"2024-05-09T01:41:01.397003+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:01.397003+0000","last_undegraded":"2024-05-09T01:41:01.397003+0000","last_fullsized":"2024-05-09T01:41:01.397003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742686+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:00.742686+0000","last_peered":"2024-05-09T01:41:00.742686+0000","last_clean":"2024-05-09T01:41:00.742686+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:00.742686+0000","last_undegraded":"2024-05-09T01:41:00.742686+0000","last_fullsized":"2024-05-09T01:41:00.742686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396340+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:41:01.396340+0000","last_peered":"2024-05-09T01:41:01.396340+0000","last_clean":"2024-05-09T01:41:01.396340+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:41:01.396340+0000","last_undegraded":"2024-05-09T01:41:01.396340+0000","last_fullsized":"2024-05-09T01:41:01.396340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396369+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:41:01.396369+0000","last_peered":"2024-05-09T01:41:01.396369+0000","last_clean":"2024-05-09T01:41:01.396369+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:41:01.396369+0000","last_undegraded":"2024-05-09T01:41:01.396369+0000","last_fullsized":"2024-05-09T01:41:01.396369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397483+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:01.397483+0000","last_peered":"2024-05-09T01:41:01.397483+0000","last_clean":"2024-05-09T01:41:01.397483+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:01.397483+0000","last_undegraded":"2024-05-09T01:41:01.397483+0000","last_fullsized":"2024-05-09T01:41:01.397483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397342+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:41:01.397342+0000","last_peered":"2024-05-09T01:41:01.397342+0000","last_clean":"2024-05-09T01:41:01.397342+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:41:01.397342+0000","last_undegraded":"2024-05-09T01:41:01.397342+0000","last_fullsized":"2024-05-09T01:41:01.397342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895471+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:00.895471+0000","last_peered":"2024-05-09T01:41:00.895471+0000","last_clean":"2024-05-09T01:41:00.895471+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:00.895471+0000","last_undegraded":"2024-05-09T01:41:00.895471+0000","last_fullsized":"2024-05-09T01:41:00.895471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743341+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:00.743341+0000","last_peered":"2024-05-09T01:41:00.743341+0000","last_clean":"2024-05-09T01:41:00.743341+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:00.743341+0000","last_undegraded":"2024-05-09T01:41:00.743341+0000","last_fullsized":"2024-05-09T01:41:00.743341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895677+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:00.895677+0000","last_peered":"2024-05-09T01:41:00.895677+0000","last_clean":"2024-05-09T01:41:00.895677+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:00.895677+0000","last_undegraded":"2024-05-09T01:41:00.895677+0000","last_fullsized":"2024-05-09T01:41:00.895677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744303+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:04.744303+0000","last_peered":"2024-05-09T01:41:04.744303+0000","last_clean":"2024-05-09T01:41:04.744303+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:04.744303+0000","last_undegraded":"2024-05-09T01:41:04.744303+0000","last_fullsized":"2024-05-09T01:41:04.744303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397004+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:41:01.397004+0000","last_peered":"2024-05-09T01:41:01.397004+0000","last_clean":"2024-05-09T01:41:01.397004+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:41:01.397004+0000","last_undegraded":"2024-05-09T01:41:01.397004+0000","last_fullsized":"2024-05-09T01:41:01.397004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742602+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:00.742602+0000","last_peered":"2024-05-09T01:41:00.742602+0000","last_clean":"2024-05-09T01:41:00.742602+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:00.742602+0000","last_undegraded":"2024-05-09T01:41:00.742602+0000","last_fullsized":"2024-05-09T01:41:00.742602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396902+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:41:01.396902+0000","last_peered":"2024-05-09T01:41:01.396902+0000","last_clean":"2024-05-09T01:41:01.396902+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:41:01.396902+0000","last_undegraded":"2024-05-09T01:41:01.396902+0000","last_fullsized":"2024-05-09T01:41:01.396902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895494+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:00.895494+0000","last_peered":"2024-05-09T01:41:00.895494+0000","last_clean":"2024-05-09T01:41:00.895494+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:00.895494+0000","last_undegraded":"2024-05-09T01:41:00.895494+0000","last_fullsized":"2024-05-09T01:41:00.895494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895478+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:00.895478+0000","last_peered":"2024-05-09T01:41:00.895478+0000","last_clean":"2024-05-09T01:41:00.895478+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:00.895478+0000","last_undegraded":"2024-05-09T01:41:00.895478+0000","last_fullsized":"2024-05-09T01:41:00.895478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.749965+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:04.749965+0000","last_peered":"2024-05-09T01:41:04.749965+0000","last_clean":"2024-05-09T01:41:04.749965+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:04.749965+0000","last_undegraded":"2024-05-09T01:41:04.749965+0000","last_fullsized":"2024-05-09T01:41:04.749965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.745067+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:04.745067+0000","last_peered":"2024-05-09T01:41:04.745067+0000","last_clean":"2024-05-09T01:41:04.745067+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:04.745067+0000","last_undegraded":"2024-05-09T01:41:04.745067+0000","last_fullsized":"2024-05-09T01:41:04.745067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.745202+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:04.745202+0000","last_peered":"2024-05-09T01:41:04.745202+0000","last_clean":"2024-05-09T01:41:04.745202+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:04.745202+0000","last_undegraded":"2024-05-09T01:41:04.745202+0000","last_fullsized":"2024-05-09T01:41:04.745202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396649+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:41:01.396649+0000","last_peered":"2024-05-09T01:41:01.396649+0000","last_clean":"2024-05-09T01:41:01.396649+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:41:01.396649+0000","last_undegraded":"2024-05-09T01:41:01.396649+0000","last_fullsized":"2024-05-09T01:41:01.396649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.222863+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:01.222863+0000","last_peered":"2024-05-09T01:41:01.222863+0000","last_clean":"2024-05-09T01:41:01.222863+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:01.222863+0000","last_undegraded":"2024-05-09T01:41:01.222863+0000","last_fullsized":"2024-05-09T01:41:01.222863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.750584+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:41:04.750584+0000","last_peered":"2024-05-09T01:41:04.750584+0000","last_clean":"2024-05-09T01:41:04.750584+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:41:04.750584+0000","last_undegraded":"2024-05-09T01:41:04.750584+0000","last_fullsized":"2024-05-09T01:41:04.750584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":75067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":815104,"data_stored":664461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:10.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:10.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.803+0000 7f81a3d15640 1 Processor -- start 2024-05-09T01:41:10.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.803+0000 7f81a3d15640 1 -- start start 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.804+0000 7f81a3d15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0c7020 0x7f819c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a3d15640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f819c0cd270 0x7f819c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a3d15640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819c0ce880 con 0x7f819c06e990 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a3d15640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f819c0ccb00 con 0x7f819c0cd270 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a3d15640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f819c0ccde0 con 0x7f819c0c7020 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f819c0cd270 0x7f819c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f819c0cd270 0x7f819c0cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35726/0 (socket says 172.21.15.42:35726) 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a12b0640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f819c06e990 0x7f819c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50404/0 (socket says 172.21.15.42:50404) 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 -- 172.21.15.42:0/310337367 learned_addr learned my addr 172.21.15.42:0/310337367 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a1ab1640 1 --2- 172.21.15.42:0/310337367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0c7020 0x7f819c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 -- 172.21.15.42:0/310337367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0c7020 msgr2=0x7f819c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:10.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 --2- 172.21.15.42:0/310337367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0c7020 0x7f819c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 -- 172.21.15.42:0/310337367 >> v1:172.21.15.42:6789/0 conn(0x7f819c06e990 legacy=0x7f819c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.805+0000 7f81a22b2640 1 -- 172.21.15.42:0/310337367 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c15d7f0 con 0x7f819c0cd270 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.806+0000 7f81a22b2640 1 --2- 172.21.15.42:0/310337367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c0cd270 0x7f819c0cd680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f818c009e50 tx=0x7f818c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5d33f5428a147a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.806+0000 7f81a0aaf640 1 -- 172.21.15.42:0/310337367 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c036070 con 0x7f819c0cd270 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.806+0000 7f81a0aaf640 1 -- 172.21.15.42:0/310337367 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818c031600 con 0x7f819c0cd270 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.806+0000 7f81a0aaf640 1 -- 172.21.15.42:0/310337367 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c0319d0 con 0x7f819c0cd270 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 -- 172.21.15.42:0/310337367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c0cd270 msgr2=0x7f819c0cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 --2- 172.21.15.42:0/310337367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c0cd270 0x7f819c0cd680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f818c009e50 tx=0x7f818c02a680 comp rx=0 tx=0).stop 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 -- 172.21.15.42:0/310337367 shutdown_connections 2024-05-09T01:41:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 --2- 172.21.15.42:0/310337367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c0cd270 0x7f819c0cd680 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 --2- 172.21.15.42:0/310337367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0c7020 0x7f819c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 -- 172.21.15.42:0/310337367 >> 172.21.15.42:0/310337367 conn(0x7f819c068ef0 msgr2=0x7f819c0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 -- 172.21.15.42:0/310337367 shutdown_connections 2024-05-09T01:41:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.807+0000 7f81a3d15640 1 -- 172.21.15.42:0/310337367 wait complete. 2024-05-09T01:41:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.809+0000 7f81a3d15640 1 Processor -- start 2024-05-09T01:41:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.809+0000 7f81a3d15640 1 -- start start 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a3d15640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 0x7f819c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a3d15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f819c0c7020 0x7f819c0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a3d15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0cd270 0x7f819c0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a3d15640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f819c15da90 con 0x7f819c06e990 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a3d15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f819c0ce5a0 con 0x7f819c0c7020 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a3d15640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f819c0cdbc0 con 0x7f819c0cd270 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 0x7f819c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 0x7f819c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35740/0 (socket says 172.21.15.42:35740) 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 -- 172.21.15.42:0/3489961686 learned_addr learned my addr 172.21.15.42:0/3489961686 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a12b0640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f819c0c7020 0x7f819c0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a22b2640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0cd270 0x7f819c0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 -- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0cd270 msgr2=0x7f819c0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0cd270 0x7f819c0cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 -- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f819c0c7020 msgr2=0x7f819c0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:10.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f819c0c7020 0x7f819c0caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:10.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.810+0000 7f81a1ab1640 1 -- 172.21.15.42:0/3489961686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c151190 con 0x7f819c06e990 2024-05-09T01:41:10.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.811+0000 7f81a1ab1640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 0x7f819c150c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f819400e870 tx=0x7f819400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:10.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.813+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194017070 con 0x7f819c06e990 2024-05-09T01:41:10.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.813+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819c1f67d0 con 0x7f819c06e990 2024-05-09T01:41:10.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.813+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819c1f6d90 con 0x7f819c06e990 2024-05-09T01:41:10.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.813+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819400c8e0 con 0x7f819c06e990 2024-05-09T01:41:10.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.813+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194021060 con 0x7f819c06e990 2024-05-09T01:41:10.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.814+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f819c0b55c0 con 0x7f819c06e990 2024-05-09T01:41:10.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.815+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f819401a070 con 0x7f819c06e990 2024-05-09T01:41:10.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.816+0000 7f819a7fc640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f81880762d0 0x7f81880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:10.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.816+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8194097b80 con 0x7f819c06e990 2024-05-09T01:41:10.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.816+0000 7f81a12b0640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f81880762d0 0x7f81880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:10.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.816+0000 7f81a12b0640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f81880762d0 0x7f81880787e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f819c1f0a10 tx=0x7f8190000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:10.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:10.820+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f819c0b55c0 con 0x7f819c06e990 2024-05-09T01:41:11.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.008+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f819c150870 con 0x7f81880762d0 2024-05-09T01:41:11.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.021+0000 7f819a7fc640 1 -- 172.21.15.42:0/3489961686 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f819c150870 con 0x7f81880762d0 2024-05-09T01:41:11.022 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:11.023 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f81880762d0 msgr2=0x7f81880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f81880762d0 0x7f81880787e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f819c1f0a10 tx=0x7f8190000bc0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 msgr2=0x7f819c150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 0x7f819c150c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f819400e870 tx=0x7f819400ed30 comp rx=0 tx=0).stop 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 shutdown_connections 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f81880762d0 0x7f81880787e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f819c0cd270 0x7f819c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f819c0c7020 0x7f819c0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 --2- 172.21.15.42:0/3489961686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f819c06e990 0x7f819c150c50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 >> 172.21.15.42:0/3489961686 conn(0x7f819c068ef0 msgr2=0x7f819c155320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:11.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 shutdown_connections 2024-05-09T01:41:11.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.024+0000 7f81a3d15640 1 -- 172.21.15.42:0/3489961686 wait complete. 2024-05-09T01:41:11.033 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-09T01:41:10.215990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239784,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734936,"statfs":{"total":773094113280,"available":772848574464,"internally_reserved":0,"allocated":2924544,"data_stored":1773196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002757"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396949+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:41:01.396949+0000","last_peered":"2024-05-09T01:41:01.396949+0000","last_clean":"2024-05-09T01:41:01.396949+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:41:01.396949+0000","last_undegraded":"2024-05-09T01:41:01.396949+0000","last_fullsized":"2024-05-09T01:41:01.396949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397106+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:41:01.397106+0000","last_peered":"2024-05-09T01:41:01.397106+0000","last_clean":"2024-05-09T01:41:01.397106+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:41:01.397106+0000","last_undegraded":"2024-05-09T01:41:01.397106+0000","last_fullsized":"2024-05-09T01:41:01.397106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397038+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:41:01.397038+0000","last_peered":"2024-05-09T01:41:01.397038+0000","last_clean":"2024-05-09T01:41:01.397038+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:41:01.397038+0000","last_undegraded":"2024-05-09T01:41:01.397038+0000","last_fullsized":"2024-05-09T01:41:01.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396661+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:41:01.396661+0000","last_peered":"2024-05-09T01:41:01.396661+0000","last_clean":"2024-05-09T01:41:01.396661+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:41:01.396661+0000","last_undegraded":"2024-05-09T01:41:01.396661+0000","last_fullsized":"2024-05-09T01:41:01.396661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397057+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:41:01.397057+0000","last_peered":"2024-05-09T01:41:01.397057+0000","last_clean":"2024-05-09T01:41:01.397057+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:41:01.397057+0000","last_undegraded":"2024-05-09T01:41:01.397057+0000","last_fullsized":"2024-05-09T01:41:01.397057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396811+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:41:01.396811+0000","last_peered":"2024-05-09T01:41:01.396811+0000","last_clean":"2024-05-09T01:41:01.396811+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:41:01.396811+0000","last_undegraded":"2024-05-09T01:41:01.396811+0000","last_fullsized":"2024-05-09T01:41:01.396811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396364+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:41:01.396364+0000","last_peered":"2024-05-09T01:41:01.396364+0000","last_clean":"2024-05-09T01:41:01.396364+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:41:01.396364+0000","last_undegraded":"2024-05-09T01:41:01.396364+0000","last_fullsized":"2024-05-09T01:41:01.396364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:42.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396374+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:41:01.396374+0000","last_peered":"2024-05-09T01:41:01.396374+0000","last_clean":"2024-05-09T01:41:01.396374+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:41:01.396374+0000","last_undegraded":"2024-05-09T01:41:01.396374+0000","last_fullsized":"2024-05-09T01:41:01.396374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.222814+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:01.222814+0000","last_peered":"2024-05-09T01:41:01.222814+0000","last_clean":"2024-05-09T01:41:01.222814+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:01.222814+0000","last_undegraded":"2024-05-09T01:41:01.222814+0000","last_fullsized":"2024-05-09T01:41:01.222814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397053+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:41:01.397053+0000","last_peered":"2024-05-09T01:41:01.397053+0000","last_clean":"2024-05-09T01:41:01.397053+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:41:01.397053+0000","last_undegraded":"2024-05-09T01:41:01.397053+0000","last_fullsized":"2024-05-09T01:41:01.397053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:02.224327+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:02.224327+0000","last_peered":"2024-05-09T01:41:02.224327+0000","last_clean":"2024-05-09T01:41:02.224327+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:02.224327+0000","last_undegraded":"2024-05-09T01:41:02.224327+0000","last_fullsized":"2024-05-09T01:41:02.224327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738548+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:00.738548+0000","last_peered":"2024-05-09T01:41:00.738548+0000","last_clean":"2024-05-09T01:41:00.738548+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:00.738548+0000","last_undegraded":"2024-05-09T01:41:00.738548+0000","last_fullsized":"2024-05-09T01:41:00.738548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396872+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:01.396872+0000","last_peered":"2024-05-09T01:41:01.396872+0000","last_clean":"2024-05-09T01:41:01.396872+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:01.396872+0000","last_undegraded":"2024-05-09T01:41:01.396872+0000","last_fullsized":"2024-05-09T01:41:01.396872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337492+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:01.337492+0000","last_peered":"2024-05-09T01:41:01.337492+0000","last_clean":"2024-05-09T01:41:01.337492+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:01.337492+0000","last_undegraded":"2024-05-09T01:41:01.337492+0000","last_fullsized":"2024-05-09T01:41:01.337492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397065+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:01.397065+0000","last_peered":"2024-05-09T01:41:01.397065+0000","last_clean":"2024-05-09T01:41:01.397065+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:01.397065+0000","last_undegraded":"2024-05-09T01:41:01.397065+0000","last_fullsized":"2024-05-09T01:41:01.397065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396844+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:41:01.396844+0000","last_peered":"2024-05-09T01:41:01.396844+0000","last_clean":"2024-05-09T01:41:01.396844+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:41:01.396844+0000","last_undegraded":"2024-05-09T01:41:01.396844+0000","last_fullsized":"2024-05-09T01:41:01.396844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.746876+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:04.746876+0000","last_peered":"2024-05-09T01:41:04.746876+0000","last_clean":"2024-05-09T01:41:04.746876+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:04.746876+0000","last_undegraded":"2024-05-09T01:41:04.746876+0000","last_fullsized":"2024-05-09T01:41:04.746876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397303+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:41:01.397303+0000","last_peered":"2024-05-09T01:41:01.397303+0000","last_clean":"2024-05-09T01:41:01.397303+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:41:01.397303+0000","last_undegraded":"2024-05-09T01:41:01.397303+0000","last_fullsized":"2024-05-09T01:41:01.397303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.746344+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:04.746344+0000","last_peered":"2024-05-09T01:41:04.746344+0000","last_clean":"2024-05-09T01:41:04.746344+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:04.746344+0000","last_undegraded":"2024-05-09T01:41:04.746344+0000","last_fullsized":"2024-05-09T01:41:04.746344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.747048+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:04.747048+0000","last_peered":"2024-05-09T01:41:04.747048+0000","last_clean":"2024-05-09T01:41:04.747048+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:04.747048+0000","last_undegraded":"2024-05-09T01:41:04.747048+0000","last_fullsized":"2024-05-09T01:41:04.747048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397056+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:41:01.397056+0000","last_peered":"2024-05-09T01:41:01.397056+0000","last_clean":"2024-05-09T01:41:01.397056+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:41:01.397056+0000","last_undegraded":"2024-05-09T01:41:01.397056+0000","last_fullsized":"2024-05-09T01:41:01.397056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397392+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:01.397392+0000","last_peered":"2024-05-09T01:41:01.397392+0000","last_clean":"2024-05-09T01:41:01.397392+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:01.397392+0000","last_undegraded":"2024-05-09T01:41:01.397392+0000","last_fullsized":"2024-05-09T01:41:01.397392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337112+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:01.337112+0000","last_peered":"2024-05-09T01:41:01.337112+0000","last_clean":"2024-05-09T01:41:01.337112+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:01.337112+0000","last_undegraded":"2024-05-09T01:41:01.337112+0000","last_fullsized":"2024-05-09T01:41:01.337112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.746863+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:04.746863+0000","last_peered":"2024-05-09T01:41:04.746863+0000","last_clean":"2024-05-09T01:41:04.746863+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:04.746863+0000","last_undegraded":"2024-05-09T01:41:04.746863+0000","last_fullsized":"2024-05-09T01:41:04.746863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396653+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:01.396653+0000","last_peered":"2024-05-09T01:41:01.396653+0000","last_clean":"2024-05-09T01:41:01.396653+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:01.396653+0000","last_undegraded":"2024-05-09T01:41:01.396653+0000","last_fullsized":"2024-05-09T01:41:01.396653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744167+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:04.744167+0000","last_peered":"2024-05-09T01:41:04.744167+0000","last_clean":"2024-05-09T01:41:04.744167+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:04.744167+0000","last_undegraded":"2024-05-09T01:41:04.744167+0000","last_fullsized":"2024-05-09T01:41:04.744167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.225857+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:01.225857+0000","last_peered":"2024-05-09T01:41:01.225857+0000","last_clean":"2024-05-09T01:41:01.225857+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:01.225857+0000","last_undegraded":"2024-05-09T01:41:01.225857+0000","last_fullsized":"2024-05-09T01:41:01.225857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396682+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:01.396682+0000","last_peered":"2024-05-09T01:41:01.396682+0000","last_clean":"2024-05-09T01:41:01.396682+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:01.396682+0000","last_undegraded":"2024-05-09T01:41:01.396682+0000","last_fullsized":"2024-05-09T01:41:01.396682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397003+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:01.397003+0000","last_peered":"2024-05-09T01:41:01.397003+0000","last_clean":"2024-05-09T01:41:01.397003+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:01.397003+0000","last_undegraded":"2024-05-09T01:41:01.397003+0000","last_fullsized":"2024-05-09T01:41:01.397003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742686+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:00.742686+0000","last_peered":"2024-05-09T01:41:00.742686+0000","last_clean":"2024-05-09T01:41:00.742686+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:00.742686+0000","last_undegraded":"2024-05-09T01:41:00.742686+0000","last_fullsized":"2024-05-09T01:41:00.742686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396340+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:41:01.396340+0000","last_peered":"2024-05-09T01:41:01.396340+0000","last_clean":"2024-05-09T01:41:01.396340+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:41:01.396340+0000","last_undegraded":"2024-05-09T01:41:01.396340+0000","last_fullsized":"2024-05-09T01:41:01.396340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396369+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:41:01.396369+0000","last_peered":"2024-05-09T01:41:01.396369+0000","last_clean":"2024-05-09T01:41:01.396369+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:41:01.396369+0000","last_undegraded":"2024-05-09T01:41:01.396369+0000","last_fullsized":"2024-05-09T01:41:01.396369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397483+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:01.397483+0000","last_peered":"2024-05-09T01:41:01.397483+0000","last_clean":"2024-05-09T01:41:01.397483+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:01.397483+0000","last_undegraded":"2024-05-09T01:41:01.397483+0000","last_fullsized":"2024-05-09T01:41:01.397483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397342+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:41:01.397342+0000","last_peered":"2024-05-09T01:41:01.397342+0000","last_clean":"2024-05-09T01:41:01.397342+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:41:01.397342+0000","last_undegraded":"2024-05-09T01:41:01.397342+0000","last_fullsized":"2024-05-09T01:41:01.397342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895471+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:00.895471+0000","last_peered":"2024-05-09T01:41:00.895471+0000","last_clean":"2024-05-09T01:41:00.895471+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:00.895471+0000","last_undegraded":"2024-05-09T01:41:00.895471+0000","last_fullsized":"2024-05-09T01:41:00.895471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743341+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:00.743341+0000","last_peered":"2024-05-09T01:41:00.743341+0000","last_clean":"2024-05-09T01:41:00.743341+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:00.743341+0000","last_undegraded":"2024-05-09T01:41:00.743341+0000","last_fullsized":"2024-05-09T01:41:00.743341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895677+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:00.895677+0000","last_peered":"2024-05-09T01:41:00.895677+0000","last_clean":"2024-05-09T01:41:00.895677+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:00.895677+0000","last_undegraded":"2024-05-09T01:41:00.895677+0000","last_fullsized":"2024-05-09T01:41:00.895677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744303+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:04.744303+0000","last_peered":"2024-05-09T01:41:04.744303+0000","last_clean":"2024-05-09T01:41:04.744303+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:04.744303+0000","last_undegraded":"2024-05-09T01:41:04.744303+0000","last_fullsized":"2024-05-09T01:41:04.744303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397004+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:41:01.397004+0000","last_peered":"2024-05-09T01:41:01.397004+0000","last_clean":"2024-05-09T01:41:01.397004+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:41:01.397004+0000","last_undegraded":"2024-05-09T01:41:01.397004+0000","last_fullsized":"2024-05-09T01:41:01.397004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742602+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:00.742602+0000","last_peered":"2024-05-09T01:41:00.742602+0000","last_clean":"2024-05-09T01:41:00.742602+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:00.742602+0000","last_undegraded":"2024-05-09T01:41:00.742602+0000","last_fullsized":"2024-05-09T01:41:00.742602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396902+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:41:01.396902+0000","last_peered":"2024-05-09T01:41:01.396902+0000","last_clean":"2024-05-09T01:41:01.396902+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:41:01.396902+0000","last_undegraded":"2024-05-09T01:41:01.396902+0000","last_fullsized":"2024-05-09T01:41:01.396902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895494+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:00.895494+0000","last_peered":"2024-05-09T01:41:00.895494+0000","last_clean":"2024-05-09T01:41:00.895494+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:00.895494+0000","last_undegraded":"2024-05-09T01:41:00.895494+0000","last_fullsized":"2024-05-09T01:41:00.895494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895478+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:00.895478+0000","last_peered":"2024-05-09T01:41:00.895478+0000","last_clean":"2024-05-09T01:41:00.895478+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:00.895478+0000","last_undegraded":"2024-05-09T01:41:00.895478+0000","last_fullsized":"2024-05-09T01:41:00.895478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.749965+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:04.749965+0000","last_peered":"2024-05-09T01:41:04.749965+0000","last_clean":"2024-05-09T01:41:04.749965+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:04.749965+0000","last_undegraded":"2024-05-09T01:41:04.749965+0000","last_fullsized":"2024-05-09T01:41:04.749965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.745067+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:04.745067+0000","last_peered":"2024-05-09T01:41:04.745067+0000","last_clean":"2024-05-09T01:41:04.745067+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:04.745067+0000","last_undegraded":"2024-05-09T01:41:04.745067+0000","last_fullsized":"2024-05-09T01:41:04.745067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.745202+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:04.745202+0000","last_peered":"2024-05-09T01:41:04.745202+0000","last_clean":"2024-05-09T01:41:04.745202+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:04.745202+0000","last_undegraded":"2024-05-09T01:41:04.745202+0000","last_fullsized":"2024-05-09T01:41:04.745202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396649+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:41:01.396649+0000","last_peered":"2024-05-09T01:41:01.396649+0000","last_clean":"2024-05-09T01:41:01.396649+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:41:01.396649+0000","last_undegraded":"2024-05-09T01:41:01.396649+0000","last_fullsized":"2024-05-09T01:41:01.396649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.222863+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:01.222863+0000","last_peered":"2024-05-09T01:41:01.222863+0000","last_clean":"2024-05-09T01:41:01.222863+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:01.222863+0000","last_undegraded":"2024-05-09T01:41:01.222863+0000","last_fullsized":"2024-05-09T01:41:01.222863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.750584+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:41:04.750584+0000","last_peered":"2024-05-09T01:41:04.750584+0000","last_clean":"2024-05-09T01:41:04.750584+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:41:04.750584+0000","last_undegraded":"2024-05-09T01:41:04.750584+0000","last_fullsized":"2024-05-09T01:41:04.750584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":75067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":815104,"data_stored":664461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:11.036 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T01:41:11.036 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T01:41:11.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T01:41:11.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T01:41:11.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.189+0000 7f06f8ed1640 1 Processor -- start 2024-05-09T01:41:11.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.189+0000 7f06f8ed1640 1 -- start start 2024-05-09T01:41:11.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06f8ed1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06f4157100 0x7f06f4160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:11.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06f8ed1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f40c7bf0 con 0x7f06f40cdaa0 2024-05-09T01:41:11.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06f8ed1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f40c7ed0 con 0x7f06f4160ed0 2024-05-09T01:41:11.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06f8ed1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f06f40c79a0 con 0x7f06f4157100 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06f259c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f06f40cdaa0 0x7f06f40ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50408/0 (socket says 172.21.15.42:50408) 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06f259c640 1 -- 172.21.15.42:0/969143391 learned_addr learned my addr 172.21.15.42:0/969143391 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.190+0000 7f06e9d9b640 1 --2- 172.21.15.42:0/969143391 >> v2:172.21.15.181:3300/0 conn(0x7f06f4157100 0x7f06f4160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971357763 0 0) 0x7f06f40c7bf0 con 0x7f06f40cdaa0 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06e0003520 con 0x7f06f40cdaa0 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003409321 0 0) 0x7f06f40c7ed0 con 0x7f06f4160ed0 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06f40c7bf0 con 0x7f06f4160ed0 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06e9d9b640 1 -- 172.21.15.42:0/969143391 >> v1:172.21.15.181:6789/0 conn(0x7f06f4160ed0 legacy=0x7f06f40ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06e9d9b640 1 -- 172.21.15.42:0/969143391 >> v1:172.21.15.42:6789/0 conn(0x7f06f40cdaa0 legacy=0x7f06f40ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.191+0000 7f06e9d9b640 1 -- 172.21.15.42:0/969143391 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f40c81b0 con 0x7f06f4157100 2024-05-09T01:41:11.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06e9d9b640 1 --2- 172.21.15.42:0/969143391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4157100 0x7f06f4160990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06f40c7b20 tx=0x7f06dc02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f778872a3797bb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:11.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc037070 con 0x7f06f4157100 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc032440 con 0x7f06f4157100 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f1d9b640 1 -- 172.21.15.42:0/969143391 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc032810 con 0x7f06f4157100 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 -- 172.21.15.42:0/969143391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4157100 msgr2=0x7f06f4160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/969143391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4157100 0x7f06f4160990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06f40c7b20 tx=0x7f06dc02a210 comp rx=0 tx=0).stop 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 -- 172.21.15.42:0/969143391 shutdown_connections 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/969143391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4157100 0x7f06f4160990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 -- 172.21.15.42:0/969143391 >> 172.21.15.42:0/969143391 conn(0x7f06f4068610 msgr2=0x7f06f4068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 -- 172.21.15.42:0/969143391 shutdown_connections 2024-05-09T01:41:11.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.192+0000 7f06f8ed1640 1 -- 172.21.15.42:0/969143391 wait complete. 2024-05-09T01:41:11.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.194+0000 7f06f8ed1640 1 Processor -- start 2024-05-09T01:41:11.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.195+0000 7f06f8ed1640 1 -- start start 2024-05-09T01:41:11.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f8ed1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06f40cdaa0 0x7f06f415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:11.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f8ed1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 0x7f06f415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:11.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f8ed1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4160ed0 0x7f06f415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f8ed1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4160470 con 0x7f06f4157100 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f8ed1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40c8770 con 0x7f06f4160ed0 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f8ed1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f06f40ce7e0 con 0x7f06f40cdaa0 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 0x7f06f415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 0x7f06f415d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35742/0 (socket says 172.21.15.42:35742) 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 -- 172.21.15.42:0/3599419110 learned_addr learned my addr 172.21.15.42:0/3599419110 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f259c640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06f40cdaa0 0x7f06f415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06f2d9d640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4160ed0 0x7f06f415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 -- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06f40cdaa0 msgr2=0x7f06f415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06f40cdaa0 0x7f06f415f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 -- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4160ed0 msgr2=0x7f06f415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4160ed0 0x7f06f415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 -- 172.21.15.42:0/3599419110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f415afd0 con 0x7f06f4157100 2024-05-09T01:41:11.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.196+0000 7f06e9d9b640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 0x7f06f415d170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009890 tx=0x7f06dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:11.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.197+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc041030 con 0x7f06f4157100 2024-05-09T01:41:11.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.197+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc03d4e0 con 0x7f06f4157100 2024-05-09T01:41:11.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.197+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc037040 con 0x7f06f4157100 2024-05-09T01:41:11.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.197+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f415b7d0 con 0x7f06f4157100 2024-05-09T01:41:11.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.197+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f415fe50 con 0x7f06f4157100 2024-05-09T01:41:11.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.198+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f40b4e00 con 0x7f06f4157100 2024-05-09T01:41:11.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.199+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06dc044070 con 0x7f06f4157100 2024-05-09T01:41:11.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.199+0000 7f06eb7fe640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06d4076300 0x7f06d4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:11.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.199+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06dc0b7e20 con 0x7f06f4157100 2024-05-09T01:41:11.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.199+0000 7f06f259c640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06d4076300 0x7f06d4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:11.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.200+0000 7f06f259c640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06d4076300 0x7f06d4078810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005880 tx=0x7f06e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:11.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.203+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06dc0812a0 con 0x7f06f4157100 2024-05-09T01:41:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.435+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06f415f800 con 0x7f06f4157100 2024-05-09T01:41:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.435+0000 7f06eb7fe640 1 -- 172.21.15.42:0/3599419110 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f06dc0855a0 con 0x7f06f4157100 2024-05-09T01:41:11.433 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:11.433 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06d4076300 msgr2=0x7f06d4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06d4076300 0x7f06d4078810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005880 tx=0x7f06e4009040 comp rx=0 tx=0).stop 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 msgr2=0x7f06f415d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 0x7f06f415d170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009890 tx=0x7f06dc0046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 shutdown_connections 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06d4076300 0x7f06d4078810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4160ed0 0x7f06f415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06f4157100 0x7f06f415d170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 --2- 172.21.15.42:0/3599419110 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06f40cdaa0 0x7f06f415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:11.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 >> 172.21.15.42:0/3599419110 conn(0x7f06f4068610 msgr2=0x7f06f40b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:11.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.437+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 shutdown_connections 2024-05-09T01:41:11.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:11.438+0000 7f06f8ed1640 1 -- 172.21.15.42:0/3599419110 wait complete. 2024-05-09T01:41:14.447 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T01:41:14.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.577+0000 7f6ca872d640 1 Processor -- start 2024-05-09T01:41:14.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.577+0000 7f6ca872d640 1 -- start start 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca872d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca00c7020 0x7f6ca0156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca872d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ca00cd270 0x7f6ca00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca872d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca00ce880 con 0x7f6ca006e990 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca872d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca00ccb00 con 0x7f6ca00cd270 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca872d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca00ccde0 con 0x7f6ca00c7020 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca5cc8640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6ca006e990 0x7f6ca006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:42942/0 (socket says 172.21.15.42:42942) 2024-05-09T01:41:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca5cc8640 1 -- 172.21.15.42:0/3949429857 learned_addr learned my addr 172.21.15.42:0/3949429857 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca64c9640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca00c7020 0x7f6ca0156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca6cca640 1 --2- 172.21.15.42:0/3949429857 >> v2:172.21.15.181:3300/0 conn(0x7f6ca00cd270 0x7f6ca00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.579+0000 7f6ca54c7640 1 -- 172.21.15.42:0/3949429857 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846833769 0 0) 0x7f6ca00ce880 con 0x7f6ca006e990 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca54c7640 1 -- 172.21.15.42:0/3949429857 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c8c003520 con 0x7f6ca006e990 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca6cca640 1 -- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca00c7020 msgr2=0x7f6ca0156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca6cca640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca00c7020 0x7f6ca0156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca6cca640 1 -- 172.21.15.42:0/3949429857 >> v1:172.21.15.181:6789/0 conn(0x7f6ca006e990 legacy=0x7f6ca006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca6cca640 1 -- 172.21.15.42:0/3949429857 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca015d7f0 con 0x7f6ca00cd270 2024-05-09T01:41:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca64c9640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca00c7020 0x7f6ca0156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca6cca640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00cd270 0x7f6ca00cd680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c9802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd0b5594124bbc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.580+0000 7f6ca54c7640 1 -- 172.21.15.42:0/3949429857 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98031600 con 0x7f6ca00cd270 2024-05-09T01:41:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca54c7640 1 -- 172.21.15.42:0/3949429857 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c980317a0 con 0x7f6ca00cd270 2024-05-09T01:41:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca54c7640 1 -- 172.21.15.42:0/3949429857 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98031b50 con 0x7f6ca00cd270 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 -- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00cd270 msgr2=0x7f6ca00cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00cd270 0x7f6ca00cd680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c9802a5d0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 -- 172.21.15.42:0/3949429857 shutdown_connections 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00cd270 0x7f6ca00cd680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 --2- 172.21.15.42:0/3949429857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca00c7020 0x7f6ca0156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 -- 172.21.15.42:0/3949429857 >> 172.21.15.42:0/3949429857 conn(0x7f6ca0068ef0 msgr2=0x7f6ca00d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 -- 172.21.15.42:0/3949429857 shutdown_connections 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.581+0000 7f6ca872d640 1 -- 172.21.15.42:0/3949429857 wait complete. 2024-05-09T01:41:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.583+0000 7f6ca872d640 1 Processor -- start 2024-05-09T01:41:14.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.583+0000 7f6ca872d640 1 -- start start 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca872d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca006e990 0x7f6ca0159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca872d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00c7020 0x7f6ca015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca872d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 0x7f6ca014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca872d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca015da90 con 0x7f6ca00cd270 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca872d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca00ce5a0 con 0x7f6ca00c7020 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca872d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca00cdbc0 con 0x7f6ca006e990 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca6cca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 0x7f6ca014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.584+0000 7f6ca6cca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 0x7f6ca014faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35758/0 (socket says 172.21.15.42:35758) 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 -- 172.21.15.42:0/1876517791 learned_addr learned my addr 172.21.15.42:0/1876517791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca5cc8640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00c7020 0x7f6ca015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca64c9640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca006e990 0x7f6ca0159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:14.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 -- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca006e990 msgr2=0x7f6ca0159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca006e990 0x7f6ca0159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 -- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00c7020 msgr2=0x7f6ca015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00c7020 0x7f6ca015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 -- 172.21.15.42:0/1876517791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca0158080 con 0x7f6ca00cd270 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca5cc8640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00c7020 0x7f6ca015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca6cca640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 0x7f6ca014faf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9803f070 con 0x7f6ca00cd270 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98003b90 con 0x7f6ca00cd270 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca01f66b0 con 0x7f6ca00cd270 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9803b6e0 con 0x7f6ca00cd270 2024-05-09T01:41:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.585+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca01f3300 con 0x7f6ca00cd270 2024-05-09T01:41:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.586+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca01f3560 con 0x7f6ca00cd270 2024-05-09T01:41:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.587+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c9803b880 con 0x7f6ca00cd270 2024-05-09T01:41:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.587+0000 7f6c96ffd640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6c84076300 0x7f6c84078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.588+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c980b8090 con 0x7f6ca00cd270 2024-05-09T01:41:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.588+0000 7f6ca64c9640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6c84076300 0x7f6c84078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.588+0000 7f6ca64c9640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6c84076300 0x7f6c84078810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009560 tx=0x7f6c9c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:14.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.592+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c98081310 con 0x7f6ca00cd270 2024-05-09T01:41:14.720 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-05-09T01:41:14.723+0000 7f22bb5ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T01:41:14.721 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-05-09T01:41:14.723+0000 7f22bb5ba640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-09T01:41:14.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.823+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ca00ce250 con 0x7f6ca00cd270 2024-05-09T01:41:14.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.823+0000 7f6c96ffd640 1 -- 172.21.15.42:0/1876517791 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f6c98085610 con 0x7f6ca00cd270 2024-05-09T01:41:14.821 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:14.821 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6c84076300 msgr2=0x7f6c84078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6c84076300 0x7f6c84078810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009560 tx=0x7f6c9c009190 comp rx=0 tx=0).stop 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 msgr2=0x7f6ca014faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 0x7f6ca014faf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c98004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 shutdown_connections 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6c84076300 0x7f6c84078810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca00cd270 0x7f6ca014faf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ca00c7020 0x7f6ca015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 --2- 172.21.15.42:0/1876517791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ca006e990 0x7f6ca0159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 >> 172.21.15.42:0/1876517791 conn(0x7f6ca0068ef0 msgr2=0x7f6ca00b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:14.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 shutdown_connections 2024-05-09T01:41:14.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:14.825+0000 7f6ca872d640 1 -- 172.21.15.42:0/1876517791 wait complete. 2024-05-09T01:41:17.835 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T01:41:17.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.966+0000 7f2b33696640 1 Processor -- start 2024-05-09T01:41:17.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.966+0000 7f2b33696640 1 -- start start 2024-05-09T01:41:17.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.967+0000 7f2b33696640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9500 0x7f2b2c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:17.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.967+0000 7f2b33696640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b2c0b7ba0 0x7f2b2c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.967+0000 7f2b33696640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2c160420 con 0x7f2b2c0c9a80 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.967+0000 7f2b33696640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c1612f0 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.967+0000 7f2b33696640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0cc350 con 0x7f2b2c0c9500 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31432640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9500 0x7f2b2c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b30c31640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b2c0b7ba0 0x7f2b2c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31c33640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2b2c0c9a80 0x7f2b2c0ca870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:51668/0 (socket says 172.21.15.42:51668) 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31c33640 1 -- 172.21.15.42:0/1127996666 learned_addr learned my addr 172.21.15.42:0/1127996666 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31432640 1 -- 172.21.15.42:0/1127996666 >> v2:172.21.15.181:3300/0 conn(0x7f2b2c0b7ba0 msgr2=0x7f2b2c1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:17.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31432640 1 --2- 172.21.15.42:0/1127996666 >> v2:172.21.15.181:3300/0 conn(0x7f2b2c0b7ba0 0x7f2b2c1570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31432640 1 -- 172.21.15.42:0/1127996666 >> v1:172.21.15.181:6789/0 conn(0x7f2b2c0c9a80 legacy=0x7f2b2c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b31432640 1 -- 172.21.15.42:0/1127996666 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c1606e0 con 0x7f2b2c0c9500 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b23fff640 1 -- 172.21.15.42:0/1127996666 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925260699 0 0) 0x7f2b2c160420 con 0x7f2b2c0c9a80 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.968+0000 7f2b30c31640 1 --2- 172.21.15.42:0/1127996666 >> v2:172.21.15.181:3300/0 conn(0x7f2b2c0b7ba0 0x7f2b2c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.969+0000 7f2b31432640 1 --2- 172.21.15.42:0/1127996666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9500 0x7f2b2c0ce4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b280097a0 tx=0x7f2b2802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0692f2ed1907953 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.969+0000 7f2b23fff640 1 -- 172.21.15.42:0/1127996666 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28037070 con 0x7f2b2c0c9500 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.969+0000 7f2b23fff640 1 -- 172.21.15.42:0/1127996666 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b28032440 con 0x7f2b2c0c9500 2024-05-09T01:41:17.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.969+0000 7f2b23fff640 1 -- 172.21.15.42:0/1127996666 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28032810 con 0x7f2b2c0c9500 2024-05-09T01:41:17.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 -- 172.21.15.42:0/1127996666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9500 msgr2=0x7f2b2c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:17.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 --2- 172.21.15.42:0/1127996666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9500 0x7f2b2c0ce4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b280097a0 tx=0x7f2b2802a180 comp rx=0 tx=0).stop 2024-05-09T01:41:17.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 -- 172.21.15.42:0/1127996666 shutdown_connections 2024-05-09T01:41:17.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 --2- 172.21.15.42:0/1127996666 >> v2:172.21.15.181:3300/0 conn(0x7f2b2c0b7ba0 0x7f2b2c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 --2- 172.21.15.42:0/1127996666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9500 0x7f2b2c0ce4b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 -- 172.21.15.42:0/1127996666 >> 172.21.15.42:0/1127996666 conn(0x7f2b2c0d2100 msgr2=0x7f2b2c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 -- 172.21.15.42:0/1127996666 shutdown_connections 2024-05-09T01:41:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.970+0000 7f2b33696640 1 -- 172.21.15.42:0/1127996666 wait complete. 2024-05-09T01:41:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.971+0000 7f2b33696640 1 Processor -- start 2024-05-09T01:41:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.972+0000 7f2b33696640 1 -- start start 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b33696640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 0x7f2b2c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b33696640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0c9500 0x7f2b2c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b33696640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9a80 0x7f2b2c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b33696640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c160f80 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b33696640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c160ca0 con 0x7f2b2c0c9500 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b33696640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0caf80 con 0x7f2b2c0c9a80 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 0x7f2b2c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 0x7f2b2c1533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41108/0 (socket says 172.21.15.42:41108) 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 -- 172.21.15.42:0/3584963619 learned_addr learned my addr 172.21.15.42:0/3584963619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:17.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b30c31640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0c9500 0x7f2b2c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31c33640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9a80 0x7f2b2c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 -- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9a80 msgr2=0x7f2b2c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9a80 0x7f2b2c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 -- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0c9500 msgr2=0x7f2b2c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0c9500 0x7f2b2c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 -- 172.21.15.42:0/3584963619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c153910 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.973+0000 7f2b31432640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 0x7f2b2c1533d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b280098c0 tx=0x7f2b280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.974+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28037040 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.974+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b28042070 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.974+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c1f6620 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.974+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28030940 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.974+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1f6be0 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.975+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c0cbf50 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.976+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b28030ae0 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.976+0000 7f2b21ffb640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b10076300 0x7f2b10078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:17.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.976+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b280b7e30 con 0x7f2b2c0b7ba0 2024-05-09T01:41:17.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.976+0000 7f2b30c31640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b10076300 0x7f2b10078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:17.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.977+0000 7f2b30c31640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b10076300 0x7f2b10078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c151500 tx=0x7f2b1c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:17.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:17.981+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b280810c0 con 0x7f2b2c0b7ba0 2024-05-09T01:41:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.214+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b2c156cd0 con 0x7f2b2c0b7ba0 2024-05-09T01:41:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.214+0000 7f2b21ffb640 1 -- 172.21.15.42:0/3584963619 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f2b280853c0 con 0x7f2b2c0b7ba0 2024-05-09T01:41:18.212 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:18.212 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-09T01:41:18.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b10076300 msgr2=0x7f2b10078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:18.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b10076300 0x7f2b10078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c151500 tx=0x7f2b1c009190 comp rx=0 tx=0).stop 2024-05-09T01:41:18.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 msgr2=0x7f2b2c1533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:18.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 0x7f2b2c1533d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b280098c0 tx=0x7f2b280046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 shutdown_connections 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2b10076300 0x7f2b10078810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0c9a80 0x7f2b2c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0c9500 0x7f2b2c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 --2- 172.21.15.42:0/3584963619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c0b7ba0 0x7f2b2c1533d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.216+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 >> 172.21.15.42:0/3584963619 conn(0x7f2b2c0d2100 msgr2=0x7f2b2c0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.217+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 shutdown_connections 2024-05-09T01:41:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:18.217+0000 7f2b33696640 1 -- 172.21.15.42:0/3584963619 wait complete. 2024-05-09T01:41:19.721 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-05-09T01:41:19.723+0000 7f22bb5ba640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-09T01:41:21.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T01:41:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.367+0000 7f32428e9640 1 Processor -- start 2024-05-09T01:41:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.367+0000 7f32428e9640 1 -- start start 2024-05-09T01:41:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f32428e9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f323c0caf80 0x7f323c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f32428e9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c160420 con 0x7f323c0c9500 2024-05-09T01:41:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f32428e9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c1606e0 con 0x7f323c0b7ba0 2024-05-09T01:41:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f32428e9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f323c1612f0 con 0x7f323c0caf80 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f3240e86640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f323c0caf80 0x7f323c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f323bfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f323c0c9500 0x7f323c0c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47184/0 (socket says 172.21.15.42:47184) 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f323bfff640 1 -- 172.21.15.42:0/2332327975 learned_addr learned my addr 172.21.15.42:0/2332327975 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f3240e86640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f323c0caf80 0x7f323c0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41124/0 (socket says 172.21.15.42:41124) 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f3240e86640 1 -- 172.21.15.42:0/2332327975 >> v1:172.21.15.181:6789/0 conn(0x7f323c0b7ba0 legacy=0x7f323c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f3240e86640 1 -- 172.21.15.42:0/2332327975 >> v1:172.21.15.42:6789/0 conn(0x7f323c0c9500 legacy=0x7f323c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.368+0000 7f323b7fe640 1 -- 172.21.15.42:0/2332327975 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183183426 0 0) 0x7f323c1606e0 con 0x7f323c0b7ba0 2024-05-09T01:41:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.369+0000 7f3240e86640 1 -- 172.21.15.42:0/2332327975 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c1609c0 con 0x7f323c0caf80 2024-05-09T01:41:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.369+0000 7f3240e86640 1 --2- 172.21.15.42:0/2332327975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c0ce4b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f323402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d0d1e8d5cab495 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.369+0000 7f323b7fe640 1 -- 172.21.15.42:0/2332327975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234007740 con 0x7f323c0caf80 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.369+0000 7f323b7fe640 1 -- 172.21.15.42:0/2332327975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32340078e0 con 0x7f323c0caf80 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.369+0000 7f323b7fe640 1 -- 172.21.15.42:0/2332327975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234007cb0 con 0x7f323c0caf80 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 -- 172.21.15.42:0/2332327975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 msgr2=0x7f323c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 --2- 172.21.15.42:0/2332327975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c0ce4b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f323402a5f0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 -- 172.21.15.42:0/2332327975 shutdown_connections 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 --2- 172.21.15.42:0/2332327975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c0ce4b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 -- 172.21.15.42:0/2332327975 >> 172.21.15.42:0/2332327975 conn(0x7f323c0d2100 msgr2=0x7f323c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 -- 172.21.15.42:0/2332327975 shutdown_connections 2024-05-09T01:41:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.370+0000 7f32428e9640 1 -- 172.21.15.42:0/2332327975 wait complete. 2024-05-09T01:41:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.372+0000 7f32428e9640 1 Processor -- start 2024-05-09T01:41:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.372+0000 7f32428e9640 1 -- start start 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f32428e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f323c0b7ba0 0x7f323c1f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f32428e9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f323c0c9500 0x7f323c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f32428e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f32428e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f323c160f80 con 0x7f323c0caf80 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f32428e9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0cc350 con 0x7f323c0b7ba0 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f32428e9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f323c0ca190 con 0x7f323c0c9500 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f3240e86640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.373+0000 7f3240e86640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41138/0 (socket says 172.21.15.42:41138) 2024-05-09T01:41:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 -- 172.21.15.42:0/3752831701 learned_addr learned my addr 172.21.15.42:0/3752831701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f323bfff640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f323c0b7ba0 0x7f323c1f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3233fff640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f323c0c9500 0x7f323c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 -- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f323c0c9500 msgr2=0x7f323c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f323c0c9500 0x7f323c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 -- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f323c0b7ba0 msgr2=0x7f323c1f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f323c0b7ba0 0x7f323c1f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 -- 172.21.15.42:0/3752831701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c1e8fd0 con 0x7f323c0caf80 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f3240e86640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c149790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f3234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234040070 con 0x7f323c0caf80 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3234031bc0 con 0x7f323c0caf80 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c154100 con 0x7f323c0caf80 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234045460 con 0x7f323c0caf80 2024-05-09T01:41:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.374+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c1e8cf0 con 0x7f323c0caf80 2024-05-09T01:41:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.375+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323c0cbf50 con 0x7f323c0caf80 2024-05-09T01:41:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.376+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3234039040 con 0x7f323c0caf80 2024-05-09T01:41:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.377+0000 7f32397fa640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f321c0762d0 0x7f321c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.377+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32340b8f20 con 0x7f323c0caf80 2024-05-09T01:41:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.377+0000 7f323bfff640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f321c0762d0 0x7f321c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.377+0000 7f323bfff640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f321c0762d0 0x7f321c0787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f322c000f60 tx=0x7f322c007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:21.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.382+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f323c1e8fd0 con 0x7f323c0caf80 2024-05-09T01:41:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.612+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f323c0c9d90 con 0x7f323c0caf80 2024-05-09T01:41:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.612+0000 7f32397fa640 1 -- 172.21.15.42:0/3752831701 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f32340821a0 con 0x7f323c0caf80 2024-05-09T01:41:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:21.611 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T01:41:21.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f321c0762d0 msgr2=0x7f321c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f321c0762d0 0x7f321c0787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f322c000f60 tx=0x7f322c007e20 comp rx=0 tx=0).stop 2024-05-09T01:41:21.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 msgr2=0x7f323c149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c149790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f3234004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 shutdown_connections 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f321c0762d0 0x7f321c0787e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f323c0caf80 0x7f323c149790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f323c0c9500 0x7f323c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 --2- 172.21.15.42:0/3752831701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f323c0b7ba0 0x7f323c1f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 >> 172.21.15.42:0/3752831701 conn(0x7f323c0d2100 msgr2=0x7f323c075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 shutdown_connections 2024-05-09T01:41:21.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.614+0000 7f32428e9640 1 -- 172.21.15.42:0/3752831701 wait complete. 2024-05-09T01:41:21.624 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T01:41:21.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.745+0000 7f94ceb00640 1 Processor -- start 2024-05-09T01:41:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.745+0000 7f94ceb00640 1 -- start start 2024-05-09T01:41:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94ceb00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80c9500 0x7f94c80ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94ceb00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94c81570f0 0x7f94c80ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94ceb00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c8160420 con 0x7f94c80b7ba0 2024-05-09T01:41:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94ceb00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f94c81612f0 con 0x7f94c81570f0 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94ceb00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f94c80cc350 con 0x7f94c80c9500 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94c7fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f94c80b7ba0 0x7f94c80c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47196/0 (socket says 172.21.15.42:47196) 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94c7fff640 1 -- 172.21.15.42:0/2503537975 learned_addr learned my addr 172.21.15.42:0/2503537975 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.746+0000 7f94cc89c640 1 --2- 172.21.15.42:0/2503537975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80c9500 0x7f94c80ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94cd09d640 1 --2- 172.21.15.42:0/2503537975 >> v2:172.21.15.181:3300/0 conn(0x7f94c81570f0 0x7f94c80ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94c77fe640 1 -- 172.21.15.42:0/2503537975 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012233949 0 0) 0x7f94c8160420 con 0x7f94c80b7ba0 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94c77fe640 1 -- 172.21.15.42:0/2503537975 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94b8003520 con 0x7f94c80b7ba0 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94cc89c640 1 -- 172.21.15.42:0/2503537975 >> v2:172.21.15.181:3300/0 conn(0x7f94c81570f0 msgr2=0x7f94c80ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94cc89c640 1 --2- 172.21.15.42:0/2503537975 >> v2:172.21.15.181:3300/0 conn(0x7f94c81570f0 0x7f94c80ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94cc89c640 1 -- 172.21.15.42:0/2503537975 >> v1:172.21.15.42:6789/0 conn(0x7f94c80b7ba0 legacy=0x7f94c80c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94cc89c640 1 -- 172.21.15.42:0/2503537975 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c81606e0 con 0x7f94c80c9500 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.747+0000 7f94cd09d640 1 --2- 172.21.15.42:0/2503537975 >> v2:172.21.15.181:3300/0 conn(0x7f94c81570f0 0x7f94c80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.748+0000 7f94cc89c640 1 --2- 172.21.15.42:0/2503537975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80c9500 0x7f94c80ce4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0097a0 tx=0x7f94bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b8414cd2b0c04e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.748+0000 7f94c77fe640 1 -- 172.21.15.42:0/2503537975 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc037070 con 0x7f94c80c9500 2024-05-09T01:41:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.748+0000 7f94c77fe640 1 -- 172.21.15.42:0/2503537975 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc032440 con 0x7f94c80c9500 2024-05-09T01:41:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.748+0000 7f94c77fe640 1 -- 172.21.15.42:0/2503537975 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc032810 con 0x7f94c80c9500 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.748+0000 7f94ceb00640 1 -- 172.21.15.42:0/2503537975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80c9500 msgr2=0x7f94c80ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.748+0000 7f94ceb00640 1 --2- 172.21.15.42:0/2503537975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80c9500 0x7f94c80ce4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0097a0 tx=0x7f94bc02a180 comp rx=0 tx=0).stop 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.749+0000 7f94ceb00640 1 -- 172.21.15.42:0/2503537975 shutdown_connections 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.749+0000 7f94ceb00640 1 --2- 172.21.15.42:0/2503537975 >> v2:172.21.15.181:3300/0 conn(0x7f94c81570f0 0x7f94c80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.749+0000 7f94ceb00640 1 --2- 172.21.15.42:0/2503537975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80c9500 0x7f94c80ce4b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.749+0000 7f94ceb00640 1 -- 172.21.15.42:0/2503537975 >> 172.21.15.42:0/2503537975 conn(0x7f94c80d2100 msgr2=0x7f94c80d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.749+0000 7f94ceb00640 1 -- 172.21.15.42:0/2503537975 shutdown_connections 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.749+0000 7f94ceb00640 1 -- 172.21.15.42:0/2503537975 wait complete. 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.750+0000 7f94ceb00640 1 Processor -- start 2024-05-09T01:41:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.750+0000 7f94ceb00640 1 -- start start 2024-05-09T01:41:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94ceb00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80b7ba0 0x7f94c80d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94ceb00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 0x7f94c8152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94ceb00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94c81570f0 0x7f94c815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94ceb00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8160f80 con 0x7f94c80c9500 2024-05-09T01:41:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94ceb00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8160ca0 con 0x7f94c81570f0 2024-05-09T01:41:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94ceb00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f94c8157500 con 0x7f94c80b7ba0 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 0x7f94c8152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 0x7f94c8152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41144/0 (socket says 172.21.15.42:41144) 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 -- 172.21.15.42:0/1075036654 learned_addr learned my addr 172.21.15.42:0/1075036654 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94cd09d640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94c81570f0 0x7f94c815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94cc89c640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80b7ba0 0x7f94c80d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 -- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80b7ba0 msgr2=0x7f94c80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80b7ba0 0x7f94c80d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 -- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94c81570f0 msgr2=0x7f94c815ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94c81570f0 0x7f94c815ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 -- 172.21.15.42:0/1075036654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c80d09e0 con 0x7f94c80c9500 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c7fff640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 0x7f94c8152500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94b400c410 tx=0x7f94b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.752+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4017070 con 0x7f94c80c9500 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.753+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b4005ce0 con 0x7f94c80c9500 2024-05-09T01:41:21.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.753+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b40072d0 con 0x7f94c80c9500 2024-05-09T01:41:21.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.753+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c81f3620 con 0x7f94c80c9500 2024-05-09T01:41:21.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.753+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c81f3be0 con 0x7f94c80c9500 2024-05-09T01:41:21.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.753+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c80cbf50 con 0x7f94c80c9500 2024-05-09T01:41:21.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.754+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94b401a070 con 0x7f94c80c9500 2024-05-09T01:41:21.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.755+0000 7f94c57fa640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f94ac0762d0 0x7f94ac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:21.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.755+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f94b40968f0 con 0x7f94c80c9500 2024-05-09T01:41:21.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.755+0000 7f94cc89c640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f94ac0762d0 0x7f94ac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:21.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.756+0000 7f94cc89c640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f94ac0762d0 0x7f94ac0787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94bc034000 tx=0x7f94bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:21.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.760+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f94b405fb80 con 0x7f94c80c9500 2024-05-09T01:41:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.991+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94c8155fe0 con 0x7f94c80c9500 2024-05-09T01:41:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.992+0000 7f94c57fa640 1 -- 172.21.15.42:0/1075036654 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6908 (secure 0 0 0) 0x7f94b4063e80 con 0x7f94c80c9500 2024-05-09T01:41:21.989 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:21.989 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:21.278024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311,4287,4253,4247]},"id":1}]} 2024-05-09T01:41:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f94ac0762d0 msgr2=0x7f94ac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f94ac0762d0 0x7f94ac0787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94bc034000 tx=0x7f94bc02e000 comp rx=0 tx=0).stop 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 msgr2=0x7f94c8152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 0x7f94c8152500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94b400c410 tx=0x7f94b400c8d0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 shutdown_connections 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f94ac0762d0 0x7f94ac0787e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94c81570f0 0x7f94c815ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94c80c9500 0x7f94c8152500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 --2- 172.21.15.42:0/1075036654 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94c80b7ba0 0x7f94c80d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 >> 172.21.15.42:0/1075036654 conn(0x7f94c80d2100 msgr2=0x7f94c806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 shutdown_connections 2024-05-09T01:41:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:21.994+0000 7f94ceb00640 1 -- 172.21.15.42:0/1075036654 wait complete. 2024-05-09T01:41:22.003 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.121+0000 7f8c33d4d640 1 Processor -- start 2024-05-09T01:41:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.121+0000 7f8c33d4d640 1 -- start start 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.122+0000 7f8c33d4d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c2c0c9500 0x7f8c2c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.122+0000 7f8c33d4d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c160420 con 0x7f8c2c0b7ba0 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.122+0000 7f8c33d4d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c1606e0 con 0x7f8c2c1570f0 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.122+0000 7f8c33d4d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c1612f0 con 0x7f8c2c0c9500 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.122+0000 7f8c312e8640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c2c0b7ba0 0x7f8c2c0c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47206/0 (socket says 172.21.15.42:47206) 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.122+0000 7f8c312e8640 1 -- 172.21.15.42:0/1428430280 learned_addr learned my addr 172.21.15.42:0/1428430280 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.123+0000 7f8c31ae9640 1 --2- 172.21.15.42:0/1428430280 >> v2:172.21.15.181:3300/0 conn(0x7f8c2c0c9500 0x7f8c2c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.123+0000 7f8c30ae7640 1 -- 172.21.15.42:0/1428430280 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865070838 0 0) 0x7f8c2c160420 con 0x7f8c2c0b7ba0 2024-05-09T01:41:22.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.123+0000 7f8c30ae7640 1 -- 172.21.15.42:0/1428430280 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c18003520 con 0x7f8c2c0b7ba0 2024-05-09T01:41:22.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.123+0000 7f8c31ae9640 1 -- 172.21.15.42:0/1428430280 >> v1:172.21.15.181:6789/0 conn(0x7f8c2c1570f0 legacy=0x7f8c2c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.123+0000 7f8c31ae9640 1 -- 172.21.15.42:0/1428430280 >> v1:172.21.15.42:6789/0 conn(0x7f8c2c0b7ba0 legacy=0x7f8c2c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.123+0000 7f8c31ae9640 1 -- 172.21.15.42:0/1428430280 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c1609c0 con 0x7f8c2c0c9500 2024-05-09T01:41:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c31ae9640 1 --2- 172.21.15.42:0/1428430280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c0ce4b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097a0 tx=0x7f8c2802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0e2c0690a0bfeb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c30ae7640 1 -- 172.21.15.42:0/1428430280 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28037070 con 0x7f8c2c0c9500 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c30ae7640 1 -- 172.21.15.42:0/1428430280 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c28032440 con 0x7f8c2c0c9500 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c30ae7640 1 -- 172.21.15.42:0/1428430280 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28032810 con 0x7f8c2c0c9500 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1428430280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 msgr2=0x7f8c2c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1428430280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c0ce4b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097a0 tx=0x7f8c2802a230 comp rx=0 tx=0).stop 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1428430280 shutdown_connections 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1428430280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c0ce4b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.124+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1428430280 >> 172.21.15.42:0/1428430280 conn(0x7f8c2c0d2100 msgr2=0x7f8c2c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.125+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1428430280 shutdown_connections 2024-05-09T01:41:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.125+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1428430280 wait complete. 2024-05-09T01:41:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.126+0000 7f8c33d4d640 1 Processor -- start 2024-05-09T01:41:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.126+0000 7f8c33d4d640 1 -- start start 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c2c0b7ba0 0x7f8c2c1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c1e8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 0x7f8c2c14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c160f80 con 0x7f8c2c1570f0 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0cc350 con 0x7f8c2c0c9500 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c157500 con 0x7f8c2c0b7ba0 2024-05-09T01:41:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 0x7f8c2c14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 0x7f8c2c14c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41146/0 (socket says 172.21.15.42:41146) 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 -- 172.21.15.42:0/1964706876 learned_addr learned my addr 172.21.15.42:0/1964706876 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c31ae9640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c2c0b7ba0 0x7f8c2c1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c312e8640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c1e8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 -- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c2c0b7ba0 msgr2=0x7f8c2c1f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c2c0b7ba0 0x7f8c2c1f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 -- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 msgr2=0x7f8c2c1e8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c1e8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 -- 172.21.15.42:0/1964706876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c153100 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c31ae9640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c2c0b7ba0 0x7f8c2c1f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c322ea640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 0x7f8c2c14c240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c700 tx=0x7f8c2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24003b70 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24003d10 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c15fa70 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400aa10 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.128+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c151c90 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.129+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2c0cbf50 con 0x7f8c2c1570f0 2024-05-09T01:41:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.130+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c2400abb0 con 0x7f8c2c1570f0 2024-05-09T01:41:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.131+0000 7f8c227fc640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c100762d0 0x7f8c100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.131+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8c240973b0 con 0x7f8c2c1570f0 2024-05-09T01:41:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.131+0000 7f8c31ae9640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c100762d0 0x7f8c100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.131+0000 7f8c31ae9640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c100762d0 0x7f8c100787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c28034000 tx=0x7f8c2802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.136+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c24060620 con 0x7f8c2c1570f0 2024-05-09T01:41:22.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.366+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c2c151760 con 0x7f8c2c1570f0 2024-05-09T01:41:22.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.367+0000 7f8c227fc640 1 -- 172.21.15.42:0/1964706876 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6908 (secure 0 0 0) 0x7f8c24064920 con 0x7f8c2c1570f0 2024-05-09T01:41:22.365 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:22.365 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:21.278024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311,4287,4253,4247]},"id":1}]} 2024-05-09T01:41:22.365 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-05-09T01:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c100762d0 msgr2=0x7f8c100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c100762d0 0x7f8c100787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c28034000 tx=0x7f8c2802e000 comp rx=0 tx=0).stop 2024-05-09T01:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 msgr2=0x7f8c2c14c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 0x7f8c2c14c240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c700 tx=0x7f8c2400cbc0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 shutdown_connections 2024-05-09T01:41:22.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8c100762d0 0x7f8c100787e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c2c1570f0 0x7f8c2c14c240 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c2c0c9500 0x7f8c2c1e8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 --2- 172.21.15.42:0/1964706876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c2c0b7ba0 0x7f8c2c1f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 >> 172.21.15.42:0/1964706876 conn(0x7f8c2c0d2100 msgr2=0x7f8c2c155320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:22.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 shutdown_connections 2024-05-09T01:41:22.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.369+0000 7f8c33d4d640 1 -- 172.21.15.42:0/1964706876 wait complete. 2024-05-09T01:41:22.378 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:41:22.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.542+0000 7f58b719d640 1 Processor -- start 2024-05-09T01:41:22.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.542+0000 7f58b719d640 1 -- start start 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.543+0000 7f58b719d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f58b00717e0 0x7f58b00c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.543+0000 7f58b719d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b006e320 con 0x7f58b00caaf0 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.543+0000 7f58b719d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b006e600 con 0x7f58b00cbef0 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.543+0000 7f58b719d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f58b0161110 con 0x7f58b00717e0 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58b573a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f58b00caaf0 0x7f58b0160a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47218/0 (socket says 172.21.15.42:47218) 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58b573a640 1 -- 172.21.15.42:0/347213206 learned_addr learned my addr 172.21.15.42:0/347213206 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58b4f39640 1 --2- 172.21.15.42:0/347213206 >> v2:172.21.15.181:3300/0 conn(0x7f58b00717e0 0x7f58b00c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893050878 0 0) 0x7f58b006e320 con 0x7f58b00caaf0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a0003520 con 0x7f58b00caaf0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873207859 0 0) 0x7f58b006e600 con 0x7f58b00cbef0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b006e320 con 0x7f58b00cbef0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58b4f39640 1 -- 172.21.15.42:0/347213206 >> v1:172.21.15.181:6789/0 conn(0x7f58b00cbef0 legacy=0x7f58b01602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58b4f39640 1 -- 172.21.15.42:0/347213206 >> v1:172.21.15.42:6789/0 conn(0x7f58b00caaf0 legacy=0x7f58b0160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.544+0000 7f58b4f39640 1 -- 172.21.15.42:0/347213206 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b0070d00 con 0x7f58b00717e0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.545+0000 7f58b4f39640 1 --2- 172.21.15.42:0/347213206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00717e0 0x7f58b00c6f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097a0 tx=0x7f58a402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa90ccde86be225 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.545+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4037070 con 0x7f58b00717e0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.545+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4032640 con 0x7f58b00717e0 2024-05-09T01:41:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.545+0000 7f58af7fe640 1 -- 172.21.15.42:0/347213206 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4032a10 con 0x7f58b00717e0 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 -- 172.21.15.42:0/347213206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00717e0 msgr2=0x7f58b00c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 --2- 172.21.15.42:0/347213206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00717e0 0x7f58b00c6f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097a0 tx=0x7f58a402a2c0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 -- 172.21.15.42:0/347213206 shutdown_connections 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 --2- 172.21.15.42:0/347213206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00717e0 0x7f58b00c6f30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 -- 172.21.15.42:0/347213206 >> 172.21.15.42:0/347213206 conn(0x7f58b0068c40 msgr2=0x7f58b0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 -- 172.21.15.42:0/347213206 shutdown_connections 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.546+0000 7f58b719d640 1 -- 172.21.15.42:0/347213206 wait complete. 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.547+0000 7f58b719d640 1 Processor -- start 2024-05-09T01:41:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.547+0000 7f58b719d640 1 -- start start 2024-05-09T01:41:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b719d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 0x7f58b01e6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b719d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00caaf0 0x7f58b00c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b719d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58b00cbef0 0x7f58b015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b719d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58b0070ab0 con 0x7f58b00717e0 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b719d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00712c0 con 0x7f58b00caaf0 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b719d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f58b00cc300 con 0x7f58b00cbef0 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 0x7f58b01e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 0x7f58b01e6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41156/0 (socket says 172.21.15.42:41156) 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 -- 172.21.15.42:0/3365388755 learned_addr learned my addr 172.21.15.42:0/3365388755 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58affff640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00caaf0 0x7f58b00c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b573a640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58b00cbef0 0x7f58b015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 -- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58b00cbef0 msgr2=0x7f58b015f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58b00cbef0 0x7f58b015f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 -- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00caaf0 msgr2=0x7f58b00c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00caaf0 0x7f58b00c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 -- 172.21.15.42:0/3365388755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b01e6ad0 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58b4f39640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 0x7f58b01e6590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58a40098c0 tx=0x7f58a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.549+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4041020 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.550+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a40306f0 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.550+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b0151a30 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.550+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4037040 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.550+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b0151ff0 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.551+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b006db40 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.551+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58a4044020 con 0x7f58b00717e0 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.552+0000 7f58ad7fa640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5894076300 0x7f5894078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.552+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58a40b7b90 con 0x7f58b00717e0 2024-05-09T01:41:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.552+0000 7f58affff640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5894076300 0x7f5894078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.552+0000 7f58affff640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5894076300 0x7f5894078810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f589c007fd0 tx=0x7f589c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.556+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58a404b030 con 0x7f58b00717e0 2024-05-09T01:41:22.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.748+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58b00cb190 con 0x7f58b00717e0 2024-05-09T01:41:22.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.750+0000 7f58ad7fa640 1 -- 172.21.15.42:0/3365388755 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f58a4080ea0 con 0x7f58b00717e0 2024-05-09T01:41:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:22.748 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:00.734921+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:22.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5894076300 msgr2=0x7f5894078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5894076300 0x7f5894078810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f589c007fd0 tx=0x7f589c009040 comp rx=0 tx=0).stop 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 msgr2=0x7f58b01e6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 0x7f58b01e6590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58a40098c0 tx=0x7f58a40046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 shutdown_connections 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5894076300 0x7f5894078810 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58b00cbef0 0x7f58b015f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58b00caaf0 0x7f58b00c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 --2- 172.21.15.42:0/3365388755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58b00717e0 0x7f58b01e6590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 >> 172.21.15.42:0/3365388755 conn(0x7f58b0068c40 msgr2=0x7f58b015fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 shutdown_connections 2024-05-09T01:41:22.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.752+0000 7f58b719d640 1 -- 172.21.15.42:0/3365388755 wait complete. 2024-05-09T01:41:22.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:22.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.884+0000 7f279a6b1640 1 Processor -- start 2024-05-09T01:41:22.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.884+0000 7f279a6b1640 1 -- start start 2024-05-09T01:41:22.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f279a6b1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f27940c9500 0x7f27940ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f279a6b1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27941570f0 0x7f27940ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f279a6b1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2794160420 con 0x7f27940b7ba0 2024-05-09T01:41:22.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f279a6b1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f27941612f0 con 0x7f27940c9500 2024-05-09T01:41:22.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f279a6b1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f27940cc350 con 0x7f27941570f0 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f27937fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f27940b7ba0 0x7f27940c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47228/0 (socket says 172.21.15.42:47228) 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f27937fe640 1 -- 172.21.15.42:0/3361718583 learned_addr learned my addr 172.21.15.42:0/3361718583 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2793fff640 1 --2- 172.21.15.42:0/3361718583 >> v2:172.21.15.181:3300/0 conn(0x7f27940c9500 0x7f27940ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2798c4e640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27941570f0 0x7f27940ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2792ffd640 1 -- 172.21.15.42:0/3361718583 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430512713 0 0) 0x7f2794160420 con 0x7f27940b7ba0 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2793fff640 1 -- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27941570f0 msgr2=0x7f27940ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2793fff640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27941570f0 0x7f27940ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2793fff640 1 -- 172.21.15.42:0/3361718583 >> v1:172.21.15.42:6789/0 conn(0x7f27940b7ba0 legacy=0x7f27940c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2793fff640 1 -- 172.21.15.42:0/3361718583 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27941606e0 con 0x7f27940c9500 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.886+0000 7f2798c4e640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27941570f0 0x7f27940ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.887+0000 7f2793fff640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27940c9500 0x7f27940ce4b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f27840097a0 tx=0x7f278402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a19a6b023b67a788 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.887+0000 7f2792ffd640 1 -- 172.21.15.42:0/3361718583 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784037070 con 0x7f27940c9500 2024-05-09T01:41:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.887+0000 7f2792ffd640 1 -- 172.21.15.42:0/3361718583 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2784032440 con 0x7f27940c9500 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.887+0000 7f2792ffd640 1 -- 172.21.15.42:0/3361718583 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784032810 con 0x7f27940c9500 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 -- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27940c9500 msgr2=0x7f27940ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27940c9500 0x7f27940ce4b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f27840097a0 tx=0x7f278402a180 comp rx=0 tx=0).stop 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 -- 172.21.15.42:0/3361718583 shutdown_connections 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27941570f0 0x7f27940ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 --2- 172.21.15.42:0/3361718583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27940c9500 0x7f27940ce4b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 -- 172.21.15.42:0/3361718583 >> 172.21.15.42:0/3361718583 conn(0x7f27940d2100 msgr2=0x7f27940d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 -- 172.21.15.42:0/3361718583 shutdown_connections 2024-05-09T01:41:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.888+0000 7f279a6b1640 1 -- 172.21.15.42:0/3361718583 wait complete. 2024-05-09T01:41:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.890+0000 7f279a6b1640 1 Processor -- start 2024-05-09T01:41:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.890+0000 7f279a6b1640 1 -- start start 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f279a6b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 0x7f27941f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f279a6b1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27940c9500 0x7f2794152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f279a6b1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27941570f0 0x7f279414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f279a6b1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2794160f80 con 0x7f27940b7ba0 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f279a6b1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2794160ca0 con 0x7f27941570f0 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f279a6b1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2794157500 con 0x7f27940c9500 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f2793fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 0x7f27941f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f2793fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 0x7f27941f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41172/0 (socket says 172.21.15.42:41172) 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f2793fff640 1 -- 172.21.15.42:0/1128577626 learned_addr learned my addr 172.21.15.42:0/1128577626 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f2798c4e640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27941570f0 0x7f279414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.891+0000 7f27937fe640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27940c9500 0x7f2794152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2798c4e640 1 -- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27940c9500 msgr2=0x7f2794152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2798c4e640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27940c9500 0x7f2794152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2798c4e640 1 -- 172.21.15.42:0/1128577626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 msgr2=0x7f27941f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2798c4e640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 0x7f27941f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2798c4e640 1 -- 172.21.15.42:0/1128577626 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27940d0e60 con 0x7f27941570f0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2793fff640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 0x7f27941f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2798c4e640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27941570f0 0x7f279414ce70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f278c00efc0 tx=0x7f278c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c018030 con 0x7f27941570f0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c00cd30 con 0x7f27941570f0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27941f42e0 con 0x7f27941570f0 2024-05-09T01:41:22.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c003bb0 con 0x7f27941570f0 2024-05-09T01:41:22.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.892+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27941f35e0 con 0x7f27941570f0 2024-05-09T01:41:22.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.893+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27940d1030 con 0x7f27941570f0 2024-05-09T01:41:22.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.894+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f278c005d10 con 0x7f27941570f0 2024-05-09T01:41:22.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.894+0000 7f2790ff9640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2780076300 0x7f2780078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.894+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f278c097ce0 con 0x7f27941570f0 2024-05-09T01:41:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.894+0000 7f2793fff640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2780076300 0x7f2780078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.895+0000 7f2793fff640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2780076300 0x7f2780078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f278402a1c0 tx=0x7f278402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:22.900+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f278c022070 con 0x7f27941570f0 2024-05-09T01:41:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.133+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f279415f7a0 con 0x7f27941570f0 2024-05-09T01:41:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.133+0000 7f2790ff9640 1 -- 172.21.15.42:0/1128577626 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6908 (secure 0 0 0) 0x7f278c010040 con 0x7f27941570f0 2024-05-09T01:41:23.131 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:23.131 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:21.278024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311,4287,4253,4247]},"id":1}]} 2024-05-09T01:41:23.131 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-05-09T01:41:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2780076300 msgr2=0x7f2780078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2780076300 0x7f2780078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f278402a1c0 tx=0x7f278402e000 comp rx=0 tx=0).stop 2024-05-09T01:41:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27941570f0 msgr2=0x7f279414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27941570f0 0x7f279414ce70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f278c00efc0 tx=0x7f278c00c490 comp rx=0 tx=0).stop 2024-05-09T01:41:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 shutdown_connections 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f2780076300 0x7f2780078810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27941570f0 0x7f279414ce70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27940c9500 0x7f2794152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 --2- 172.21.15.42:0/1128577626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27940b7ba0 0x7f27941f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 >> 172.21.15.42:0/1128577626 conn(0x7f27940d2100 msgr2=0x7f27940c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 shutdown_connections 2024-05-09T01:41:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:23.136+0000 7f279a6b1640 1 -- 172.21.15.42:0/1128577626 wait complete. 2024-05-09T01:41:23.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T01:40:59.137449+0000', 'modified': '2024-05-09T01:41:21.278024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4287, 'mds_2': 4253, 'mds_3': 4247, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 4, 'incarnation': 15, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.42:6837/3957323768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 3957323768}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 3957323768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4247': {'gid': 4247, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6835/1600205649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1600205649}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1600205649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4253': {'gid': 4253, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/2888840633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2888840633}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2888840633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.42:6835/1138022510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1138022510}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1138022510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6837/1961479918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 1961479918}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 1961479918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4311, 4287, 4253, 4247]} 2024-05-09T01:41:23.749 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4241:up:creating 2024-05-09T01:41:24.721 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-05-09T01:41:24.723+0000 7f22bb5ba640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-09T01:41:24.750 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.881+0000 7ff417100640 1 Processor -- start 2024-05-09T01:41:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.881+0000 7ff417100640 1 -- start start 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff417100640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff410160d20 0x7ff410157060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff417100640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4100c9ec0 0x7ff41015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff417100640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff41006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff417100640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff41015d1a0 con 0x7ff4100c9ec0 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff417100640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff410161260 con 0x7ff410160d20 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff417100640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff4100712c0 con 0x7ff41006c670 2024-05-09T01:41:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff40ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4100c9ec0 0x7ff41015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff40ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4100c9ec0 0x7ff41015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41180/0 (socket says 172.21.15.42:41180) 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff40ffff640 1 -- 172.21.15.42:0/1767071196 learned_addr learned my addr 172.21.15.42:0/1767071196 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff414e9c640 1 --2- 172.21.15.42:0/1767071196 >> v2:172.21.15.181:3300/0 conn(0x7ff410160d20 0x7ff410157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.882+0000 7ff41569d640 1 --2- 172.21.15.42:0/1767071196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff41006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.883+0000 7ff40ffff640 1 -- 172.21.15.42:0/1767071196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 msgr2=0x7ff41006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.883+0000 7ff40ffff640 1 --2- 172.21.15.42:0/1767071196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff41006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.883+0000 7ff40ffff640 1 -- 172.21.15.42:0/1767071196 >> v2:172.21.15.181:3300/0 conn(0x7ff410160d20 msgr2=0x7ff410157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.883+0000 7ff40ffff640 1 --2- 172.21.15.42:0/1767071196 >> v2:172.21.15.181:3300/0 conn(0x7ff410160d20 0x7ff410157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.883+0000 7ff40ffff640 1 -- 172.21.15.42:0/1767071196 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4100715a0 con 0x7ff4100c9ec0 2024-05-09T01:41:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.883+0000 7ff40ffff640 1 --2- 172.21.15.42:0/1767071196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4100c9ec0 0x7ff41015d630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff41006d5e0 tx=0x7ff3fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccfa8f2977b8e73 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff40f7fe640 1 -- 172.21.15.42:0/1767071196 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc037070 con 0x7ff4100c9ec0 2024-05-09T01:41:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff40f7fe640 1 -- 172.21.15.42:0/1767071196 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc032440 con 0x7ff4100c9ec0 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff40f7fe640 1 -- 172.21.15.42:0/1767071196 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc032810 con 0x7ff4100c9ec0 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 -- 172.21.15.42:0/1767071196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4100c9ec0 msgr2=0x7ff41015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 --2- 172.21.15.42:0/1767071196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4100c9ec0 0x7ff41015d630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff41006d5e0 tx=0x7ff3fc02a140 comp rx=0 tx=0).stop 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 -- 172.21.15.42:0/1767071196 shutdown_connections 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 --2- 172.21.15.42:0/1767071196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff41006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 --2- 172.21.15.42:0/1767071196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4100c9ec0 0x7ff41015d630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 --2- 172.21.15.42:0/1767071196 >> v2:172.21.15.181:3300/0 conn(0x7ff410160d20 0x7ff410157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 -- 172.21.15.42:0/1767071196 >> 172.21.15.42:0/1767071196 conn(0x7ff41006ddb0 msgr2=0x7ff4100cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 -- 172.21.15.42:0/1767071196 shutdown_connections 2024-05-09T01:41:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.884+0000 7ff417100640 1 -- 172.21.15.42:0/1767071196 wait complete. 2024-05-09T01:41:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.886+0000 7ff417100640 1 Processor -- start 2024-05-09T01:41:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.886+0000 7ff417100640 1 -- start start 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.887+0000 7ff417100640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff410158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.887+0000 7ff417100640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4100c9ec0 0x7ff4100c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.887+0000 7ff417100640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 0x7ff4101538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.887+0000 7ff417100640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4100cc850 con 0x7ff410160d20 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.887+0000 7ff417100640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff41015ce30 con 0x7ff4100c9ec0 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.887+0000 7ff417100640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff4100ca5a0 con 0x7ff41006c670 2024-05-09T01:41:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff41569d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 0x7ff4101538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff410158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff41569d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 0x7ff4101538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41192/0 (socket says 172.21.15.42:41192) 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff41569d640 1 -- 172.21.15.42:0/1753781604 learned_addr learned my addr 172.21.15.42:0/1753781604 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff40ffff640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4100c9ec0 0x7ff4100c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 -- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4100c9ec0 msgr2=0x7ff4100c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4100c9ec0 0x7ff4100c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 -- 172.21.15.42:0/1753781604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 msgr2=0x7ff4101538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 0x7ff4101538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 -- 172.21.15.42:0/1753781604 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41015b580 con 0x7ff41006c670 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff41569d640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 0x7ff4101538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff414e9c640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff410158460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff40400e870 tx=0x7ff40400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404017070 con 0x7ff41006c670 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40400ee60 con 0x7ff41006c670 2024-05-09T01:41:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4101e8160 con 0x7ff41006c670 2024-05-09T01:41:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.888+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40400cb60 con 0x7ff41006c670 2024-05-09T01:41:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.889+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4101f39b0 con 0x7ff41006c670 2024-05-09T01:41:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.889+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff410071af0 con 0x7ff41006c670 2024-05-09T01:41:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.890+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff40401a070 con 0x7ff41006c670 2024-05-09T01:41:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.891+0000 7ff40d7fa640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff3f40762d0 0x7ff3f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.891+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff404097f40 con 0x7ff41006c670 2024-05-09T01:41:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.891+0000 7ff40ffff640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff3f40762d0 0x7ff3f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.891+0000 7ff40ffff640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff3f40762d0 0x7ff3f40787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc034000 tx=0x7ff3fc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:24.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:24.895+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff404061270 con 0x7ff41006c670 2024-05-09T01:41:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.125+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4100c8d90 con 0x7ff41006c670 2024-05-09T01:41:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.125+0000 7ff40d7fa640 1 -- 172.21.15.42:0/1753781604 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6908 (secure 0 0 0) 0x7ff404065570 con 0x7ff41006c670 2024-05-09T01:41:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:25.124 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:21.278024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311,4287,4253,4247]},"id":1}]} 2024-05-09T01:41:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff3f40762d0 msgr2=0x7ff3f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff3f40762d0 0x7ff3f40787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc034000 tx=0x7ff3fc02e000 comp rx=0 tx=0).stop 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 msgr2=0x7ff410158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff410158460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff40400e870 tx=0x7ff40400ed30 comp rx=0 tx=0).stop 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 shutdown_connections 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff3f40762d0 0x7ff3f40787e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff410160d20 0x7ff4101538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4100c9ec0 0x7ff4100c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 --2- 172.21.15.42:0/1753781604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff41006c670 0x7ff410158460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 >> 172.21.15.42:0/1753781604 conn(0x7ff41006ddb0 msgr2=0x7ff4100cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 shutdown_connections 2024-05-09T01:41:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:25.127+0000 7ff417100640 1 -- 172.21.15.42:0/1753781604 wait complete. 2024-05-09T01:41:25.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T01:40:59.137449+0000', 'modified': '2024-05-09T01:41:21.278024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4287, 'mds_2': 4253, 'mds_3': 4247, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 4, 'incarnation': 15, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.42:6837/3957323768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 3957323768}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 3957323768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4247': {'gid': 4247, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6835/1600205649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1600205649}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1600205649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4253': {'gid': 4253, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/2888840633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2888840633}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2888840633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.42:6835/1138022510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1138022510}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1138022510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6837/1961479918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 1961479918}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 1961479918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4311, 4287, 4253, 4247]} 2024-05-09T01:41:25.741 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4241:up:creating 2024-05-09T01:41:26.742 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.873+0000 7f9368627640 1 Processor -- start 2024-05-09T01:41:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.873+0000 7f9368627640 1 -- start start 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9368627640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600c76f0 0x7f93600cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9368627640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9360165660 0x7f9360167a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9368627640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936015cf00 con 0x7f93600b4e00 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9368627640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f93600ce800 con 0x7f9360165660 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9368627640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f93600ccb30 con 0x7f93600c76f0 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9360165660 0x7f9360167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9360165660 0x7f9360167a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41194/0 (socket says 172.21.15.42:41194) 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 -- 172.21.15.42:0/3000724919 learned_addr learned my addr 172.21.15.42:0/3000724919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:26.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f93663c3640 1 --2- 172.21.15.42:0/3000724919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600c76f0 0x7f93600cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:26.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 -- 172.21.15.42:0/3000724919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600c76f0 msgr2=0x7f93600cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:26.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 --2- 172.21.15.42:0/3000724919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600c76f0 0x7f93600cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:26.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 -- 172.21.15.42:0/3000724919 >> v1:172.21.15.181:6789/0 conn(0x7f93600b4e00 legacy=0x7f936006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:26.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.875+0000 7f9366bc4640 1 -- 172.21.15.42:0/3000724919 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93600ccd80 con 0x7f9360165660 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.876+0000 7f9366bc4640 1 --2- 172.21.15.42:0/3000724919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f9360167a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd69dc832ca0560 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.876+0000 7f93653c1640 1 -- 172.21.15.42:0/3000724919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358036070 con 0x7f9360165660 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.876+0000 7f93653c1640 1 -- 172.21.15.42:0/3000724919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9358031600 con 0x7f9360165660 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.876+0000 7f93653c1640 1 -- 172.21.15.42:0/3000724919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93580319d0 con 0x7f9360165660 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 -- 172.21.15.42:0/3000724919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 msgr2=0x7f9360167a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 --2- 172.21.15.42:0/3000724919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f9360167a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935802a680 comp rx=0 tx=0).stop 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 -- 172.21.15.42:0/3000724919 shutdown_connections 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 --2- 172.21.15.42:0/3000724919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f9360167a80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:26.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 --2- 172.21.15.42:0/3000724919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600c76f0 0x7f93600cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:26.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 -- 172.21.15.42:0/3000724919 >> 172.21.15.42:0/3000724919 conn(0x7f9360068de0 msgr2=0x7f93600d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:26.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 -- 172.21.15.42:0/3000724919 shutdown_connections 2024-05-09T01:41:26.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.877+0000 7f9368627640 1 -- 172.21.15.42:0/3000724919 wait complete. 2024-05-09T01:41:26.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.879+0000 7f9368627640 1 Processor -- start 2024-05-09T01:41:26.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.879+0000 7f9368627640 1 -- start start 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9368627640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600b4e00 0x7f93601f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9368627640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93600c76f0 0x7f93600d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9368627640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f936014de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9368627640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f93600ce4a0 con 0x7f9360165660 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9368627640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f93600cd3d0 con 0x7f93600c76f0 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9368627640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f93601572c0 con 0x7f93600b4e00 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9366bc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f936014de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f93663c3640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600b4e00 0x7f93601f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:26.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9366bc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f936014de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41210/0 (socket says 172.21.15.42:41210) 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9366bc4640 1 -- 172.21.15.42:0/3567368651 learned_addr learned my addr 172.21.15.42:0/3567368651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.880+0000 7f9365bc2640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93600c76f0 0x7f93600d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9366bc4640 1 -- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600b4e00 msgr2=0x7f93601f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9366bc4640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600b4e00 0x7f93601f7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9366bc4640 1 -- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93600c76f0 msgr2=0x7f93600d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9366bc4640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93600c76f0 0x7f93600d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9366bc4640 1 -- 172.21.15.42:0/3567368651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93601f6560 con 0x7f9360165660 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9366bc4640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f936014de50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9358009f70 tx=0x7f9358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935803f020 con 0x7f9360165660 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9358037040 con 0x7f9360165660 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93600d1fc0 con 0x7f9360165660 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358036070 con 0x7f9360165660 2024-05-09T01:41:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.881+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93600d22a0 con 0x7f9360165660 2024-05-09T01:41:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.882+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93600ce280 con 0x7f9360165660 2024-05-09T01:41:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.883+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9358042020 con 0x7f9360165660 2024-05-09T01:41:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.883+0000 7f9356ffd640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f93440762d0 0x7f93440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.884+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f93580b79e0 con 0x7f9360165660 2024-05-09T01:41:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.884+0000 7f93663c3640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f93440762d0 0x7f93440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.884+0000 7f93663c3640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f93440762d0 0x7f93440787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f935c009aa0 tx=0x7f935c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:26.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:26.888+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9358049030 con 0x7f9360165660 2024-05-09T01:41:27.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.118+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93600cf160 con 0x7f9360165660 2024-05-09T01:41:27.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.118+0000 7f9356ffd640 1 -- 172.21.15.42:0/3567368651 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6908 (secure 0 0 0) 0x7f9358080c50 con 0x7f9360165660 2024-05-09T01:41:27.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:27.117 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:21.278024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311,4287,4253,4247]},"id":1}]} 2024-05-09T01:41:27.117 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f93440762d0 msgr2=0x7f93440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f93440762d0 0x7f93440787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f935c009aa0 tx=0x7f935c009190 comp rx=0 tx=0).stop 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 msgr2=0x7f936014de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f936014de50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9358009f70 tx=0x7f9358004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 shutdown_connections 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f93440762d0 0x7f93440787e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:27.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360165660 0x7f936014de50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:27.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93600c76f0 0x7f93600d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:27.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 --2- 172.21.15.42:0/3567368651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93600b4e00 0x7f93601f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:27.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 >> 172.21.15.42:0/3567368651 conn(0x7f9360068de0 msgr2=0x7f93600b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:27.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 shutdown_connections 2024-05-09T01:41:27.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:27.120+0000 7f9368627640 1 -- 172.21.15.42:0/3567368651 wait complete. 2024-05-09T01:41:27.293 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-05-09T01:41:27.295+0000 7f22bddbf640 -1 quiesce.mds.0 failed to decode message of type 1285 v1: End of buffer [buffer:2] 2024-05-09T01:41:27.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T01:40:59.137449+0000', 'modified': '2024-05-09T01:41:21.278024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4287, 'mds_2': 4253, 'mds_3': 4247, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 4, 'incarnation': 15, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.42:6837/3957323768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 3957323768}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 3957323768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4247': {'gid': 4247, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6835/1600205649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1600205649}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1600205649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4253': {'gid': 4253, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/2888840633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2888840633}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2888840633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.42:6835/1138022510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1138022510}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1138022510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6837/1961479918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 1961479918}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 1961479918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4311, 4287, 4253, 4247]} 2024-05-09T01:41:27.736 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4241:up:creating 2024-05-09T01:41:28.737 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:28.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.868+0000 7f5a7ab00640 1 Processor -- start 2024-05-09T01:41:28.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.868+0000 7f5a7ab00640 1 -- start start 2024-05-09T01:41:28.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7ab00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5a740c7020 0x7f5a74156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:28.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7ab00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a740ce880 con 0x7f5a7406e990 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7ab00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7415d7f0 con 0x7f5a740cd270 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7ab00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5a740ccb00 con 0x7f5a740c7020 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7889c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5a740c7020 0x7f5a74156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7889c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5a740c7020 0x7f5a74156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59932/0 (socket says 172.21.15.42:59932) 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a73fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5a7406e990 0x7f5a7406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:32998/0 (socket says 172.21.15.42:32998) 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7889c640 1 -- 172.21.15.42:0/1257888505 learned_addr learned my addr 172.21.15.42:0/1257888505 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7889c640 1 -- 172.21.15.42:0/1257888505 >> v1:172.21.15.181:6789/0 conn(0x7f5a740cd270 legacy=0x7f5a740cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7889c640 1 -- 172.21.15.42:0/1257888505 >> v1:172.21.15.42:6789/0 conn(0x7f5a7406e990 legacy=0x7f5a7406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a737fe640 1 -- 172.21.15.42:0/1257888505 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800655563 0 0) 0x7f5a7415d7f0 con 0x7f5a740cd270 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.870+0000 7f5a7889c640 1 -- 172.21.15.42:0/1257888505 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740ce020 con 0x7f5a740c7020 2024-05-09T01:41:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.871+0000 7f5a7889c640 1 --2- 172.21.15.42:0/1257888505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740c7020 0x7f5a74156d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009870 tx=0x7f5a6402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e6287087399815 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:28.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.871+0000 7f5a737fe640 1 -- 172.21.15.42:0/1257888505 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64037070 con 0x7f5a740c7020 2024-05-09T01:41:28.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.871+0000 7f5a737fe640 1 -- 172.21.15.42:0/1257888505 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6402adf0 con 0x7f5a740c7020 2024-05-09T01:41:28.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.871+0000 7f5a737fe640 1 -- 172.21.15.42:0/1257888505 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64032660 con 0x7f5a740c7020 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 -- 172.21.15.42:0/1257888505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740c7020 msgr2=0x7f5a74156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/1257888505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740c7020 0x7f5a74156d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009870 tx=0x7f5a6402a160 comp rx=0 tx=0).stop 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 -- 172.21.15.42:0/1257888505 shutdown_connections 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/1257888505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740c7020 0x7f5a74156d40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 -- 172.21.15.42:0/1257888505 >> 172.21.15.42:0/1257888505 conn(0x7f5a74068ef0 msgr2=0x7f5a740d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 -- 172.21.15.42:0/1257888505 shutdown_connections 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.872+0000 7f5a7ab00640 1 -- 172.21.15.42:0/1257888505 wait complete. 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.874+0000 7f5a7ab00640 1 Processor -- start 2024-05-09T01:41:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.874+0000 7f5a7ab00640 1 -- start start 2024-05-09T01:41:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7ab00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a7406e990 0x7f5a741f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7ab00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a740c7020 0x7f5a741f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7ab00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 0x7f5a741e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7ab00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7415da90 con 0x7f5a740cd270 2024-05-09T01:41:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7ab00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740ccde0 con 0x7f5a7406e990 2024-05-09T01:41:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7ab00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7406dcc0 con 0x7f5a740c7020 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7909d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 0x7f5a741e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7909d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 0x7f5a741e9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59944/0 (socket says 172.21.15.42:59944) 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7889c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a7406e990 0x7f5a741f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a7909d640 1 -- 172.21.15.42:0/3328385871 learned_addr learned my addr 172.21.15.42:0/3328385871 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.875+0000 7f5a73fff640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a740c7020 0x7f5a741f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7909d640 1 -- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a740c7020 msgr2=0x7f5a741f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7909d640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a740c7020 0x7f5a741f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7909d640 1 -- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a7406e990 msgr2=0x7f5a741f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7909d640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a7406e990 0x7f5a741f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7909d640 1 -- 172.21.15.42:0/3328385871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a741f3660 con 0x7f5a740cd270 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7909d640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 0x7f5a741e9800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c760 tx=0x7f5a6c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c003b70 con 0x7f5a740cd270 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c003d10 con 0x7f5a740cd270 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c005290 con 0x7f5a740cd270 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7415a880 con 0x7f5a740cd270 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.876+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7415ab20 con 0x7f5a740cd270 2024-05-09T01:41:28.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.877+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a740ce250 con 0x7f5a740cd270 2024-05-09T01:41:28.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.878+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a6c005430 con 0x7f5a740cd270 2024-05-09T01:41:28.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.878+0000 7f5a717fa640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5a60076300 0x7f5a60078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:28.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.879+0000 7f5a7889c640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5a60076300 0x7f5a60078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:28.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.879+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c097390 con 0x7f5a740cd270 2024-05-09T01:41:28.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.879+0000 7f5a7889c640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5a60076300 0x7f5a60078810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a64034000 tx=0x7f5a6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:28.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:28.884+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a6c060590 con 0x7f5a740cd270 2024-05-09T01:41:29.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.120+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a7414eb70 con 0x7f5a740cd270 2024-05-09T01:41:29.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.120+0000 7f5a717fa640 1 -- 172.21.15.42:0/3328385871 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f5a6c064890 con 0x7f5a740cd270 2024-05-09T01:41:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:29.119 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:41:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:41:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5a60076300 msgr2=0x7f5a60078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5a60076300 0x7f5a60078810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a64034000 tx=0x7f5a6402e000 comp rx=0 tx=0).stop 2024-05-09T01:41:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 msgr2=0x7f5a741e9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 0x7f5a741e9800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c760 tx=0x7f5a6c00cb60 comp rx=0 tx=0).stop 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 shutdown_connections 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5a60076300 0x7f5a60078810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a740cd270 0x7f5a741e9800 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a740c7020 0x7f5a741f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 --2- 172.21.15.42:0/3328385871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a7406e990 0x7f5a741f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 >> 172.21.15.42:0/3328385871 conn(0x7f5a74068ef0 msgr2=0x7f5a740cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 shutdown_connections 2024-05-09T01:41:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.122+0000 7f5a7ab00640 1 -- 172.21.15.42:0/3328385871 wait complete. 2024-05-09T01:41:29.721 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-05-09T01:41:29.724+0000 7f22bb5ba640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-09T01:41:29.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T01:40:59.137449+0000', 'modified': '2024-05-09T01:41:27.292881+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4287, 'mds_2': 4253, 'mds_3': 4247, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 4, 'incarnation': 15, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.42:6837/3957323768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 3957323768}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 3957323768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4247': {'gid': 4247, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6835/1600205649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1600205649}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1600205649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4253': {'gid': 4253, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/2888840633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2888840633}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2888840633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.42:6835/1138022510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1138022510}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1138022510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6837/1961479918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 1961479918}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 1961479918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4241, 4247, 4253, 4287, 4311]} 2024-05-09T01:41:29.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-09T01:41:29.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-09T01:41:29.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.862+0000 7fe665c89640 1 Processor -- start 2024-05-09T01:41:29.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.862+0000 7fe665c89640 1 -- start start 2024-05-09T01:41:29.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe665c89640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe6600c88e0 0x7fe660153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe665c89640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe6600737d0 0x7fe660070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe665c89640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe660073be0 0x7fe6600713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe665c89640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe660074d50 con 0x7fe6600737d0 2024-05-09T01:41:29.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe665c89640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe6600c8dd0 con 0x7fe6600c88e0 2024-05-09T01:41:29.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe665c89640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe6600c9090 con 0x7fe660073be0 2024-05-09T01:41:29.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe6600737d0 0x7fe660070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe6600737d0 0x7fe660070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59958/0 (socket says 172.21.15.42:59958) 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 -- 172.21.15.42:0/3529510185 learned_addr learned my addr 172.21.15.42:0/3529510185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/3529510185 >> v2:172.21.15.181:3300/0 conn(0x7fe6600c88e0 0x7fe660153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe65ffff640 1 --2- 172.21.15.42:0/3529510185 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe660073be0 0x7fe6600713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 -- 172.21.15.42:0/3529510185 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe660073be0 msgr2=0x7fe6600713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 --2- 172.21.15.42:0/3529510185 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe660073be0 0x7fe6600713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 -- 172.21.15.42:0/3529510185 >> v2:172.21.15.181:3300/0 conn(0x7fe6600c88e0 msgr2=0x7fe660153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 --2- 172.21.15.42:0/3529510185 >> v2:172.21.15.181:3300/0 conn(0x7fe6600c88e0 0x7fe660153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.864+0000 7fe657fff640 1 -- 172.21.15.42:0/3529510185 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe660159fa0 con 0x7fe6600737d0 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.865+0000 7fe657fff640 1 --2- 172.21.15.42:0/3529510185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6600737d0 0x7fe660070e90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6600cc660 tx=0x7fe64802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c862f0628daacc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.865+0000 7fe65effd640 1 -- 172.21.15.42:0/3529510185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648032790 con 0x7fe6600737d0 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.865+0000 7fe65effd640 1 -- 172.21.15.42:0/3529510185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648038070 con 0x7fe6600737d0 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.865+0000 7fe65effd640 1 -- 172.21.15.42:0/3529510185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648032b50 con 0x7fe6600737d0 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.865+0000 7fe665c89640 1 -- 172.21.15.42:0/3529510185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6600737d0 msgr2=0x7fe660070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.865+0000 7fe665c89640 1 --2- 172.21.15.42:0/3529510185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6600737d0 0x7fe660070e90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6600cc660 tx=0x7fe64802c890 comp rx=0 tx=0).stop 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 -- 172.21.15.42:0/3529510185 shutdown_connections 2024-05-09T01:41:29.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 --2- 172.21.15.42:0/3529510185 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe660073be0 0x7fe6600713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 --2- 172.21.15.42:0/3529510185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6600737d0 0x7fe660070e90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 --2- 172.21.15.42:0/3529510185 >> v2:172.21.15.181:3300/0 conn(0x7fe6600c88e0 0x7fe660153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 -- 172.21.15.42:0/3529510185 >> 172.21.15.42:0/3529510185 conn(0x7fe6600cb850 msgr2=0x7fe6600cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 -- 172.21.15.42:0/3529510185 shutdown_connections 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.866+0000 7fe665c89640 1 -- 172.21.15.42:0/3529510185 wait complete. 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.867+0000 7fe665c89640 1 Processor -- start 2024-05-09T01:41:29.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.867+0000 7fe665c89640 1 -- start start 2024-05-09T01:41:29.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe665c89640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6600737d0 0x7fe660149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe665c89640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 0x7fe660152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe665c89640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6600c88e0 0x7fe6601f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe665c89640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe660159c50 con 0x7fe660073be0 2024-05-09T01:41:29.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe665c89640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe66015a560 con 0x7fe6600737d0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe665c89640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe6600c9bf0 con 0x7fe6600c88e0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 0x7fe660152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 0x7fe660152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59962/0 (socket says 172.21.15.42:59962) 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 -- 172.21.15.42:0/3468250157 learned_addr learned my addr 172.21.15.42:0/3468250157 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6600737d0 0x7fe660149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe65ffff640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6600c88e0 0x7fe6601f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 -- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6600c88e0 msgr2=0x7fe6601f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6600c88e0 0x7fe6601f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 -- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6600737d0 msgr2=0x7fe660149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6600737d0 0x7fe660149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 -- 172.21.15.42:0/3468250157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66014ce40 con 0x7fe660073be0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe657fff640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 0x7fe660152980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe64802c8d0 tx=0x7fe6480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:29.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe65cff9640 1 -- 172.21.15.42:0/3468250157 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648033620 con 0x7fe660073be0 2024-05-09T01:41:29.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.869+0000 7fe65cff9640 1 -- 172.21.15.42:0/3468250157 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6480337c0 con 0x7fe660073be0 2024-05-09T01:41:29.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.870+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe660157890 con 0x7fe660073be0 2024-05-09T01:41:29.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.870+0000 7fe65cff9640 1 -- 172.21.15.42:0/3468250157 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648033bb0 con 0x7fe660073be0 2024-05-09T01:41:29.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.870+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66006ddd0 con 0x7fe660073be0 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.871+0000 7fe65cff9640 1 -- 172.21.15.42:0/3468250157 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe64804d060 con 0x7fe660073be0 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.872+0000 7fe65cff9640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe640076300 0x7fe640078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.872+0000 7fe65cff9640 1 -- 172.21.15.42:0/3468250157 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe6480b9fe0 con 0x7fe660073be0 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.872+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe640076300 0x7fe640078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.873+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe640076300 0x7fe640078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe650009aa0 tx=0x7fe650009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.873+0000 7fe66cc1c740 1 Processor -- start 2024-05-09T01:41:29.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.873+0000 7fe66cc1c740 1 -- start start 2024-05-09T01:41:29.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.874+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x564640393c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.874+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.874+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.874+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5646402b54e0 con 0x56463ff8c590 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.874+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564640250ff0 con 0x56463ff843b0 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.874+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5646402b14a0 con 0x56463ffad270 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403777e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59976/0 (socket says 172.21.15.42:59976) 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe657fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 -- 172.21.15.42:0/1436810055 learned_addr learned my addr 172.21.15.42:0/1436810055 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x564640393c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 -- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 msgr2=0x564640393c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x564640393c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 -- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 msgr2=0x5646403772a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403772a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 -- 172.21.15.42:0/1436810055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564640237720 con 0x56463ff8c590 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe65ffff640 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403777e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe658011260 tx=0x7fe65800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f983d6c11704a8dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe6557fa640 1 -- 172.21.15.42:0/1436810055 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65801a070 con 0x56463ff8c590 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe6557fa640 1 -- 172.21.15.42:0/1436810055 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe658016860 con 0x56463ff8c590 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.875+0000 7fe6557fa640 1 -- 172.21.15.42:0/1436810055 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658016c50 con 0x56463ff8c590 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1436810055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 msgr2=0x5646403777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403777e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe658011260 tx=0x7fe65800b040 comp rx=0 tx=0).stop 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1436810055 shutdown_connections 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403777e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403772a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1436810055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x564640393c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1436810055 >> 172.21.15.42:0/1436810055 conn(0x56463ffa13c0 msgr2=0x5646403518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:29.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1436810055 shutdown_connections 2024-05-09T01:41:29.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.876+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1436810055 wait complete. 2024-05-09T01:41:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.877+0000 7fe66cc1c740 1 -- start start 2024-05-09T01:41:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.877+0000 7fe66cc1c740 1 Processor -- start 2024-05-09T01:41:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x56464038dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x5646403742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564640351700 con 0x56463ff8c590 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56464023c760 con 0x56463ff843b0 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5646403a38c0 con 0x56463ffad270 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe66cc1c740 10 client.0 _ll_register_callbacks cb 0x56464025f4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59984/0 (socket says 172.21.15.42:59984) 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe657fff640 1 -- 172.21.15.42:0/2640717417 learned_addr learned my addr 172.21.15.42:0/2640717417 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.878+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x56464038dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe65ffff640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x5646403742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe657fff640 1 -- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 msgr2=0x5646403742a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe657fff640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x5646403742a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe657fff640 1 -- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 msgr2=0x56464038dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe657fff640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x56464038dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe657fff640 1 -- 172.21.15.42:0/2640717417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464027dbd0 con 0x56463ff8c590 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x56464038dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe657fff640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403a2eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe648082fe0 tx=0x7fe648082b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a54e3b50d487a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe63e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe63e7fc640 1 -- 172.21.15.42:0/2640717417 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648087370 con 0x56463ff8c590 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe63e7fc640 1 -- 172.21.15.42:0/2640717417 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe64808bb70 con 0x56463ff8c590 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe658016860 con 0x56463ff8c590 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe63e7fc640 1 -- 172.21.15.42:0/2640717417 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fe6480b8050 con 0x56463ff8c590 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe66cc1c740 10 client.4653 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x564640263280 con 0x56463ff8c590 2024-05-09T01:41:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.879+0000 7fe63e7fc640 1 -- 172.21.15.42:0/2640717417 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe658016860 con 0x56463ff8c590 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe63e7fc640 1 -- 172.21.15.42:0/2640717417 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fe64800e040 con 0x56463ff8c590 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe66cc1c740 10 client.4653 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe66cc1c740 10 client.4653 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe66cc1c740 20 client.4653 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe66cc1c740 4 client.4653 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 --> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646402c30f0 con 0x56463ff6be40 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe65f7fe640 1 -- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 msgr2=0x564640374960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe65f7fe640 1 -- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 msgr2=0x564640374960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T01:41:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:29.880+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T01:41:30.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:30.081+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:30.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:30.081+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f30d0a60ee186e7c server_cookie=443ca991444f8381 in_seq=0 out_seq=0 2024-05-09T01:41:30.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:30.081+0000 7fe63e7fc640 10 client.4653 ms_handle_connect on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:31.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:41:31.266 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.296+0000 7fe63e7fc640 1 -- 172.21.15.42:0/2640717417 <== mds.4 v2:172.21.15.42:6836/3957323768 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5646402c30f0 con 0x56463ff6be40 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.296+0000 7fe63e7fc640 10 client.4653 handle_command_reply: tid=0 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.296+0000 7fe66cc1c740 1 client.4653 shutdown 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 msgr2=0x5646403a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403a2eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe648082fe0 tx=0x7fe648082b10 comp rx=0 tx=0).stop 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 shutdown_connections 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56463ff6be40 0x564640374960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x5646403742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403a2eb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe63e7fc640 0 client.4653 ms_handle_reset on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2640717417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x56464038dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 >> 172.21.15.42:0/2640717417 conn(0x56463ffa13c0 msgr2=0x56464034c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 shutdown_connections 2024-05-09T01:41:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2640717417 wait complete. 2024-05-09T01:41:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.297+0000 7fe66cc1c740 20 client.4653 trim_cache size 0 max 16384 2024-05-09T01:41:32.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.318+0000 7fe66cc1c740 1 Processor -- start 2024-05-09T01:41:32.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.318+0000 7fe66cc1c740 1 -- start start 2024-05-09T01:41:32.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ff843b0 0x5646403b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x56464034d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ffad270 0x56464034d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601531a0 con 0x56463ff8c590 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56464038c730 con 0x56463ffad270 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5646403a36f0 con 0x56463ff843b0 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x56464034d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.319+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x56464034d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59998/0 (socket says 172.21.15.42:59998) 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 -- 172.21.15.42:0/2453001191 learned_addr learned my addr 172.21.15.42:0/2453001191 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe65ffff640 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ffad270 0x56464034d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ff843b0 0x5646403b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 -- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ff843b0 msgr2=0x5646403b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ff843b0 0x5646403b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 -- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ffad270 msgr2=0x56464034d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ffad270 0x56464034d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 -- 172.21.15.42:0/2453001191 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564640018850 con 0x56463ff8c590 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe657fff640 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x56464034d3a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe648080550 tx=0x7fe648085000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b34ded48b67afe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe654ff9640 1 -- 172.21.15.42:0/2453001191 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6480875e0 con 0x56463ff8c590 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe654ff9640 1 -- 172.21.15.42:0/2453001191 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648038040 con 0x56463ff8c590 2024-05-09T01:41:32.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.320+0000 7fe654ff9640 1 -- 172.21.15.42:0/2453001191 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64808c000 con 0x56463ff8c590 2024-05-09T01:41:32.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2453001191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 msgr2=0x56464034d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x56464034d3a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe648080550 tx=0x7fe648085000 comp rx=0 tx=0).stop 2024-05-09T01:41:32.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2453001191 shutdown_connections 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ffad270 0x56464034d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x56464034d3a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/2453001191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ff843b0 0x5646403b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.321+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2453001191 >> 172.21.15.42:0/2453001191 conn(0x56463ffa13c0 msgr2=0x5646403503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.322+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2453001191 shutdown_connections 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.322+0000 7fe66cc1c740 1 -- 172.21.15.42:0/2453001191 wait complete. 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.322+0000 7fe66cc1c740 1 -- start start 2024-05-09T01:41:32.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.323+0000 7fe66cc1c740 1 Processor -- start 2024-05-09T01:41:32.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x56464039feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5646403747e0 con 0x56463ff8c590 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564640397420 con 0x56463ff843b0 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5646403a5fd0 con 0x56463ffad270 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe66cc1c740 10 client.0 _ll_register_callbacks cb 0x7fe64807f250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe657fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60008/0 (socket says 172.21.15.42:60008) 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe657fff640 1 -- 172.21.15.42:0/1630250619 learned_addr learned my addr 172.21.15.42:0/1630250619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe65ffff640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x56464039feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.324+0000 7fe657fff640 1 -- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 msgr2=0x56464039feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe657fff640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x56464039feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe657fff640 1 -- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 msgr2=0x5646403511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe657fff640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe657fff640 1 -- 172.21.15.42:0/1630250619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464008f6b0 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe65ffff640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x56464039feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe657fff640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403737f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe64807f360 tx=0x7fe6480b83d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae353f739b066e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe63e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe63e7fc640 1 -- 172.21.15.42:0/1630250619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64808c000 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe63e7fc640 1 -- 172.21.15.42:0/1630250619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe648085c10 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe648038040 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe63e7fc640 1 -- 172.21.15.42:0/1630250619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fe648087380 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe66cc1c740 10 client.4659 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x564640271630 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.325+0000 7fe63e7fc640 1 -- 172.21.15.42:0/1630250619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648038040 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe63e7fc640 1 -- 172.21.15.42:0/1630250619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fe64808bb70 con 0x56463ff8c590 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe66cc1c740 10 client.4659 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe66cc1c740 10 client.4659 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe66cc1c740 20 client.4659 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56464040d1f0 0x56464040d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe66cc1c740 4 client.4659 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 --> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] -- command(tid 0: {"prefix": "status"}) -- 0x5646402bcf60 con 0x56464040d1f0 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56464040d1f0 0x56464040d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe63e7fc640 10 client.4659 ms_handle_connect on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.326+0000 7fe65f7fe640 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56464040d1f0 0x56464040d600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=96005ea48c8bee75 server_cookie=a983ecc4024d77ba in_seq=0 out_seq=0 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe63e7fc640 1 -- 172.21.15.42:0/1630250619 <== mds.4 v2:172.21.15.42:6836/3957323768 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5646402bcf60 con 0x56464040d1f0 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe63e7fc640 10 client.4659 handle_command_reply: tid=0 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 client.4659 shutdown 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 msgr2=0x5646403737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403737f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe64807f360 tx=0x7fe6480b83d0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 shutdown_connections 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x56464040d1f0 0x56464040d600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56463ffad270 0x56464039feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56463ff8c590 0x5646403737f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 --2- 172.21.15.42:0/1630250619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56463ff843b0 0x5646403511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 >> 172.21.15.42:0/1630250619 conn(0x56463ffa13c0 msgr2=0x5646403503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe63e7fc640 0 client.4659 ms_handle_reset on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 shutdown_connections 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 1 -- 172.21.15.42:0/1630250619 wait complete. 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.327+0000 7fe66cc1c740 20 client.4659 trim_cache size 0 max 16384 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4241, 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.045920018, 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 38.616762753000003 2024-05-09T01:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe640076300 msgr2=0x7fe640078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe640076300 0x7fe640078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe650009aa0 tx=0x7fe650009190 comp rx=0 tx=0).stop 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 msgr2=0x7fe660152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 0x7fe660152980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe64802c8d0 tx=0x7fe6480046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 shutdown_connections 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe640076300 0x7fe640078810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6600c88e0 0x7fe6601f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe660073be0 0x7fe660152980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 --2- 172.21.15.42:0/3468250157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6600737d0 0x7fe660149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 >> 172.21.15.42:0/3468250157 conn(0x7fe6600cb850 msgr2=0x7fe6601590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 shutdown_connections 2024-05-09T01:41:32.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.328+0000 7fe665c89640 1 -- 172.21.15.42:0/3468250157 wait complete. 2024-05-09T01:41:32.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-09T01:41:32.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.463+0000 7f6b89213640 1 Processor -- start 2024-05-09T01:41:32.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.463+0000 7f6b89213640 1 -- start start 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b89213640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6b840cdaa0 0x7f6b84157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b89213640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6b840ce4e0 0x7f6b840ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b89213640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b840c7bf0 con 0x7f6b840ce0d0 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b89213640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6b840ce8f0 con 0x7f6b840cdaa0 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b89213640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6b840c79a0 con 0x7f6b840ce4e0 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6b840cdaa0 0x7f6b84157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6b840cdaa0 0x7f6b84157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60022/0 (socket says 172.21.15.42:60022) 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 -- 172.21.15.42:0/2592838525 learned_addr learned my addr 172.21.15.42:0/2592838525 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b8359e640 1 --2- 172.21.15.42:0/2592838525 >> v2:172.21.15.181:3300/0 conn(0x7f6b840ce4e0 0x7f6b840ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 -- 172.21.15.42:0/2592838525 >> v2:172.21.15.181:3300/0 conn(0x7f6b840ce4e0 msgr2=0x7f6b840ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/2592838525 >> v2:172.21.15.181:3300/0 conn(0x7f6b840ce4e0 0x7f6b840ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 -- 172.21.15.42:0/2592838525 >> v1:172.21.15.181:6789/0 conn(0x7f6b840ce0d0 legacy=0x7f6b84160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.465+0000 7f6b82d9d640 1 -- 172.21.15.42:0/2592838525 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b840c7ed0 con 0x7f6b840cdaa0 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.466+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/2592838525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84157100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b840900d0 tx=0x7f6b7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bae77fd87d72ee3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.466+0000 7f6b81d9b640 1 -- 172.21.15.42:0/2592838525 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74037070 con 0x7f6b840cdaa0 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.466+0000 7f6b81d9b640 1 -- 172.21.15.42:0/2592838525 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b74032440 con 0x7f6b840cdaa0 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.466+0000 7f6b81d9b640 1 -- 172.21.15.42:0/2592838525 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74032810 con 0x7f6b840cdaa0 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 -- 172.21.15.42:0/2592838525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 msgr2=0x7f6b84157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 --2- 172.21.15.42:0/2592838525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84157100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b840900d0 tx=0x7f6b7402a1e0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 -- 172.21.15.42:0/2592838525 shutdown_connections 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 --2- 172.21.15.42:0/2592838525 >> v2:172.21.15.181:3300/0 conn(0x7f6b840ce4e0 0x7f6b840ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 --2- 172.21.15.42:0/2592838525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84157100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 -- 172.21.15.42:0/2592838525 >> 172.21.15.42:0/2592838525 conn(0x7f6b84068610 msgr2=0x7f6b84068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 -- 172.21.15.42:0/2592838525 shutdown_connections 2024-05-09T01:41:32.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.467+0000 7f6b89213640 1 -- 172.21.15.42:0/2592838525 wait complete. 2024-05-09T01:41:32.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.469+0000 7f6b89213640 1 Processor -- start 2024-05-09T01:41:32.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.469+0000 7f6b89213640 1 -- start start 2024-05-09T01:41:32.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b89213640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b89213640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b840ce0d0 0x7f6b840b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b89213640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b840ce4e0 0x7f6b84147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b89213640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b840c8770 con 0x7f6b840cdaa0 2024-05-09T01:41:32.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b89213640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b840c8490 con 0x7f6b840ce0d0 2024-05-09T01:41:32.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b89213640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6b84160470 con 0x7f6b840ce4e0 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60034/0 (socket says 172.21.15.42:60034) 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3898764619 learned_addr learned my addr 172.21.15.42:0/3898764619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b8259c640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b840ce0d0 0x7f6b840b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.470+0000 7f6b8359e640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b840ce4e0 0x7f6b84147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b840ce4e0 msgr2=0x7f6b84147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b840ce4e0 0x7f6b84147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b840ce0d0 msgr2=0x7f6b840b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b840ce0d0 0x7f6b840b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3898764619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b84150780 con 0x7f6b840cdaa0 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84151880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b74000c00 tx=0x7f6b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b7b7fe640 1 -- 172.21.15.42:0/3898764619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74041020 con 0x7f6b840cdaa0 2024-05-09T01:41:32.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b7b7fe640 1 -- 172.21.15.42:0/3898764619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b740306c0 con 0x7f6b840cdaa0 2024-05-09T01:41:32.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b841e8c50 con 0x7f6b840cdaa0 2024-05-09T01:41:32.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b7b7fe640 1 -- 172.21.15.42:0/3898764619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74037040 con 0x7f6b840cdaa0 2024-05-09T01:41:32.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.471+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b841e8ef0 con 0x7f6b840cdaa0 2024-05-09T01:41:32.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.473+0000 7f6b7b7fe640 1 -- 172.21.15.42:0/3898764619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b74044020 con 0x7f6b840cdaa0 2024-05-09T01:41:32.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.474+0000 7f6b7b7fe640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6b64076300 0x7f6b64078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.474+0000 7f6b7b7fe640 1 -- 172.21.15.42:0/3898764619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6b740b7d70 con 0x7f6b840cdaa0 2024-05-09T01:41:32.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.474+0000 7f6b8259c640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6b64076300 0x7f6b64078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.474+0000 7f6b8259c640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6b64076300 0x7f6b64078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b8414bd90 tx=0x7f6b6c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.475+0000 7f6b901a2740 1 Processor -- start 2024-05-09T01:41:32.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.475+0000 7f6b901a2740 1 -- start start 2024-05-09T01:41:32.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 0x560984332c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f233b0 0x5609843162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609843167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b901a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5609842544e0 con 0x560983f4c270 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5609841efff0 con 0x560983f2b590 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5609842504a0 con 0x560983f233b0 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 0x560984332c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 0x560984332c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60046/0 (socket says 172.21.15.42:60046) 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 -- 172.21.15.42:0/451009442 learned_addr learned my addr 172.21.15.42:0/451009442 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b8359e640 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609843167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b8259c640 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f233b0 0x5609843162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 -- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f233b0 msgr2=0x5609843162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f233b0 0x5609843162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 -- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 msgr2=0x5609843167e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609843167e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.476+0000 7f6b82d9d640 1 -- 172.21.15.42:0/451009442 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609841d6720 con 0x560983f4c270 2024-05-09T01:41:32.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.477+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 0x560984332c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b74033fd0 tx=0x7f6b7407d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b59b81f713207b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.477+0000 7f6b78ff9640 1 -- 172.21.15.42:0/451009442 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740852d0 con 0x560983f4c270 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.477+0000 7f6b78ff9640 1 -- 172.21.15.42:0/451009442 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b74089d80 con 0x560983f4c270 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.477+0000 7f6b78ff9640 1 -- 172.21.15.42:0/451009442 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74089b30 con 0x560983f4c270 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.477+0000 7f6b901a2740 1 -- 172.21.15.42:0/451009442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 msgr2=0x560984332c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.477+0000 7f6b901a2740 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 0x560984332c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b74033fd0 tx=0x7f6b7407d750 comp rx=0 tx=0).stop 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 -- 172.21.15.42:0/451009442 shutdown_connections 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609843167e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f233b0 0x5609843162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 --2- 172.21.15.42:0/451009442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f4c270 0x560984332c80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 -- 172.21.15.42:0/451009442 >> 172.21.15.42:0/451009442 conn(0x560983f403c0 msgr2=0x5609842f08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 -- 172.21.15.42:0/451009442 shutdown_connections 2024-05-09T01:41:32.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 -- 172.21.15.42:0/451009442 wait complete. 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.478+0000 7f6b901a2740 1 -- start start 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.479+0000 7f6b901a2740 1 Processor -- start 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x56098432f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843134c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x560984313a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5609842f0700 con 0x560983f233b0 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5609841db760 con 0x560983f4c270 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56098432fcc0 con 0x560983f2b590 2024-05-09T01:41:32.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b901a2740 10 client.0 _ll_register_callbacks cb 0x5609841fe4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x56098432f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x56098432f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60058/0 (socket says 172.21.15.42:60058) 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 -- 172.21.15.42:0/4155304095 learned_addr learned my addr 172.21.15.42:0/4155304095 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b8259c640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b8359e640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x560984313a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 -- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 msgr2=0x5609843134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 -- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 msgr2=0x560984313a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x560984313a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 -- 172.21.15.42:0/4155304095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098421cbd0 con 0x560983f233b0 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x56098432f780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b740b8060 tx=0x7f6b74008070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44faa23131734284 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.480+0000 7f6b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b61ffb640 1 -- 172.21.15.42:0/4155304095 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740852d0 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b61ffb640 1 -- 172.21.15.42:0/4155304095 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6b7409bdc0 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b74089d80 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b61ffb640 1 -- 172.21.15.42:0/4155304095 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6b7407c940 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 10 client.4671 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x560984202280 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b61ffb640 1 -- 172.21.15.42:0/4155304095 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b74089d80 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b61ffb640 1 -- 172.21.15.42:0/4155304095 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f6b74084030 con 0x560983f233b0 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 10 client.4671 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 10 client.4671 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 20 client.4671 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x560983f0ae40 0x560984345b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 4 client.4671 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 --> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609842620f0 con 0x560983f0ae40 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.481+0000 7f6b8259c640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x560983f0ae40 0x560984345b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.482+0000 7f6b61ffb640 10 client.4671 ms_handle_connect on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.482+0000 7f6b8259c640 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x560983f0ae40 0x560984345b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7f1576c5b7fd71d6 server_cookie=5c2c7fed6a54e84c in_seq=0 out_seq=0 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b61ffb640 1 -- 172.21.15.42:0/4155304095 <== mds.3 v2:172.21.15.181:6834/1600205649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5609842620f0 con 0x560983f0ae40 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b61ffb640 10 client.4671 handle_command_reply: tid=0 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 client.4671 shutdown 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 msgr2=0x56098432f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x56098432f780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b740b8060 tx=0x7f6b74008070 comp rx=0 tx=0).stop 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 shutdown_connections 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x560983f0ae40 0x560984345b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x560984313a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843134c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 --2- 172.21.15.42:0/4155304095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x56098432f780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 >> 172.21.15.42:0/4155304095 conn(0x560983f403c0 msgr2=0x56098432ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b61ffb640 0 client.4671 ms_handle_reset on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 shutdown_connections 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 1 -- 172.21.15.42:0/4155304095 wait complete. 2024-05-09T01:41:32.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.483+0000 7f6b901a2740 20 client.4671 trim_cache size 0 max 16384 2024-05-09T01:41:32.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.502+0000 7f6b901a2740 1 Processor -- start 2024-05-09T01:41:32.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.502+0000 7f6b901a2740 1 -- start start 2024-05-09T01:41:32.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984345b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x5609843560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b901a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b84148430 con 0x560983f233b0 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56098432fcc0 con 0x560983f4c270 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5609842f0700 con 0x560983f2b590 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984345b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984345b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60064/0 (socket says 172.21.15.42:60064) 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 -- 172.21.15.42:0/1022145060 learned_addr learned my addr 172.21.15.42:0/1022145060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 -- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 msgr2=0x5609843460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b8259c640 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b8359e640 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x5609843560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 -- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 msgr2=0x5609843560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x5609843560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.503+0000 7f6b82d9d640 1 -- 172.21.15.42:0/1022145060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560983fb7850 con 0x560983f233b0 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984345b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b7407d5c0 tx=0x7f6b740b1070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23aaaf32a731af6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b63fff640 1 -- 172.21.15.42:0/1022145060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740852d0 con 0x560983f233b0 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b63fff640 1 -- 172.21.15.42:0/1022145060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b740b3070 con 0x560983f233b0 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b63fff640 1 -- 172.21.15.42:0/1022145060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74089d80 con 0x560983f233b0 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 -- 172.21.15.42:0/1022145060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 msgr2=0x560984345b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984345b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b7407d5c0 tx=0x7f6b740b1070 comp rx=0 tx=0).stop 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 -- 172.21.15.42:0/1022145060 shutdown_connections 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f4c270 0x5609843560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f2b590 0x5609843460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 --2- 172.21.15.42:0/1022145060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984345b90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 -- 172.21.15.42:0/1022145060 >> 172.21.15.42:0/1022145060 conn(0x560983f403c0 msgr2=0x5609842ed8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.504+0000 7f6b901a2740 1 -- 172.21.15.42:0/1022145060 shutdown_connections 2024-05-09T01:41:32.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.505+0000 7f6b901a2740 1 -- 172.21.15.42:0/1022145060 wait complete. 2024-05-09T01:41:32.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.505+0000 7f6b901a2740 1 -- start start 2024-05-09T01:41:32.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.505+0000 7f6b901a2740 1 Processor -- start 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984339370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609842ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f4c270 0x5609843ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560984345a10 con 0x560983f233b0 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5609841db760 con 0x560983f2b590 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56098432ef70 con 0x560983f4c270 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 10 client.0 _ll_register_callbacks cb 0x7f6b7c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984339370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984339370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60078/0 (socket says 172.21.15.42:60078) 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3941294667 learned_addr learned my addr 172.21.15.42:0/3941294667 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b8259c640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609842ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b8359e640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f4c270 0x5609843ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f4c270 msgr2=0x5609843ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f4c270 0x5609843ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 msgr2=0x5609842ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609842ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 -- 172.21.15.42:0/3941294667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098402e6b0 con 0x560983f233b0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b8359e640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f4c270 0x5609843ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b82d9d640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984339370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b7407e240 tx=0x7f6b74009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc3fdde3992091e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b61ffb640 1 -- 172.21.15.42:0/3941294667 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7407fea0 con 0x560983f233b0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b61ffb640 1 -- 172.21.15.42:0/3941294667 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6b7409bdc0 con 0x560983f233b0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b740b3070 con 0x560983f233b0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b61ffb640 1 -- 172.21.15.42:0/3941294667 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6b74080040 con 0x560983f233b0 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.507+0000 7f6b901a2740 10 client.4677 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x560984210630 con 0x560983f233b0 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b61ffb640 1 -- 172.21.15.42:0/3941294667 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b740b3070 con 0x560983f233b0 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b61ffb640 1 -- 172.21.15.42:0/3941294667 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f6b74084070 con 0x560983f233b0 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 10 client.4677 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 10 client.4677 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 20 client.4677 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5609842ef180 0x5609842ef590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 4 client.4677 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 --> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] -- command(tid 0: {"prefix": "status"}) -- 0x56098425bf60 con 0x5609842ef180 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b8259c640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5609842ef180 0x5609842ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b61ffb640 10 client.4677 ms_handle_connect on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b8259c640 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5609842ef180 0x5609842ef590 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a27209d3d000c574 server_cookie=5187800be7b281b2 in_seq=0 out_seq=0 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b61ffb640 1 -- 172.21.15.42:0/3941294667 <== mds.3 v2:172.21.15.181:6834/1600205649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56098425bf60 con 0x5609842ef180 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.508+0000 7f6b61ffb640 10 client.4677 handle_command_reply: tid=0 2024-05-09T01:41:32.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 client.4677 shutdown 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 msgr2=0x560984339370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984339370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b7407e240 tx=0x7f6b74009240 comp rx=0 tx=0).stop 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 shutdown_connections 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5609842ef180 0x5609842ef590 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560983f4c270 0x5609843ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560983f2b590 0x5609842ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 --2- 172.21.15.42:0/3941294667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560983f233b0 0x560984339370 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b61ffb640 0 client.4677 ms_handle_reset on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 >> 172.21.15.42:0/3941294667 conn(0x560983f403c0 msgr2=0x56098432af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 shutdown_connections 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 1 -- 172.21.15.42:0/3941294667 wait complete. 2024-05-09T01:41:32.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b901a2740 20 client.4677 trim_cache size 0 max 16384 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4247, 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 16.674956846000001, 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:32.513 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:32.514 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 38.786602438000003 2024-05-09T01:41:32.514 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6b64076300 msgr2=0x7f6b64078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6b64076300 0x7f6b64078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b8414bd90 tx=0x7f6b6c007e30 comp rx=0 tx=0).stop 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 msgr2=0x7f6b84151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84151880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b74000c00 tx=0x7f6b740046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 shutdown_connections 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6b64076300 0x7f6b64078810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b840ce4e0 0x7f6b84147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b840ce0d0 0x7f6b840b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 --2- 172.21.15.42:0/3898764619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b840cdaa0 0x7f6b84151880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 >> 172.21.15.42:0/3898764619 conn(0x7f6b84068610 msgr2=0x7f6b84068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 shutdown_connections 2024-05-09T01:41:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.509+0000 7f6b89213640 1 -- 172.21.15.42:0/3898764619 wait complete. 2024-05-09T01:41:32.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T01:41:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.636+0000 7f0a3df27640 1 Processor -- start 2024-05-09T01:41:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.636+0000 7f0a3df27640 1 -- start start 2024-05-09T01:41:32.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.637+0000 7f0a3df27640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0a38071be0 0x7f0a380c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.637+0000 7f0a3df27640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0a38154b20 0x7f0a3815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.637+0000 7f0a3df27640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a380caa10 con 0x7f0a38154f30 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.637+0000 7f0a3df27640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0a38071750 con 0x7f0a38154b20 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.637+0000 7f0a3df27640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0a380cb200 con 0x7f0a38071be0 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a37fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0a38154f30 0x7f0a3815e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:49938/0 (socket says 172.21.15.42:49938) 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a37fff640 1 -- 172.21.15.42:0/2742568231 learned_addr learned my addr 172.21.15.42:0/2742568231 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a377fe640 1 --2- 172.21.15.42:0/2742568231 >> v2:172.21.15.181:3300/0 conn(0x7f0a38071be0 0x7f0a380c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/2742568231 >> v2:172.21.15.42:3300/0 conn(0x7f0a38154b20 0x7f0a3815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a367fc640 1 -- 172.21.15.42:0/2742568231 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274464953 0 0) 0x7f0a380caa10 con 0x7f0a38154f30 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a367fc640 1 -- 172.21.15.42:0/2742568231 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a20003520 con 0x7f0a38154f30 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a36ffd640 1 -- 172.21.15.42:0/2742568231 >> v2:172.21.15.181:3300/0 conn(0x7f0a38071be0 msgr2=0x7f0a380c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/2742568231 >> v2:172.21.15.181:3300/0 conn(0x7f0a38071be0 0x7f0a380c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a36ffd640 1 -- 172.21.15.42:0/2742568231 >> v1:172.21.15.181:6789/0 conn(0x7f0a38154f30 legacy=0x7f0a3815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a36ffd640 1 -- 172.21.15.42:0/2742568231 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380cb740 con 0x7f0a38154b20 2024-05-09T01:41:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.638+0000 7f0a377fe640 1 --2- 172.21.15.42:0/2742568231 >> v2:172.21.15.181:3300/0 conn(0x7f0a38071be0 0x7f0a380c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.639+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/2742568231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38154b20 0x7f0a3815e0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a380ca660 tx=0x7f0a2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4331c7e3ea02a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.639+0000 7f0a367fc640 1 -- 172.21.15.42:0/2742568231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c037070 con 0x7f0a38154b20 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.639+0000 7f0a367fc640 1 -- 172.21.15.42:0/2742568231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c032440 con 0x7f0a38154b20 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.639+0000 7f0a367fc640 1 -- 172.21.15.42:0/2742568231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0327f0 con 0x7f0a38154b20 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 -- 172.21.15.42:0/2742568231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38154b20 msgr2=0x7f0a3815e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 --2- 172.21.15.42:0/2742568231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38154b20 0x7f0a3815e0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a380ca660 tx=0x7f0a2c02a1a0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 -- 172.21.15.42:0/2742568231 shutdown_connections 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 --2- 172.21.15.42:0/2742568231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38154b20 0x7f0a3815e0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 --2- 172.21.15.42:0/2742568231 >> v2:172.21.15.181:3300/0 conn(0x7f0a38071be0 0x7f0a380c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 -- 172.21.15.42:0/2742568231 >> 172.21.15.42:0/2742568231 conn(0x7f0a380d0660 msgr2=0x7f0a38072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 -- 172.21.15.42:0/2742568231 shutdown_connections 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.640+0000 7f0a3df27640 1 -- 172.21.15.42:0/2742568231 wait complete. 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.642+0000 7f0a3df27640 1 Processor -- start 2024-05-09T01:41:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.642+0000 7f0a3df27640 1 -- start start 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a3df27640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a38071be0 0x7f0a38156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a3df27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a38154b20 0x7f0a381560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a3df27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 0x7f0a38147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a3df27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380713e0 con 0x7f0a38147ce0 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a3df27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38071100 con 0x7f0a38154b20 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a3df27640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380c5780 con 0x7f0a38071be0 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 0x7f0a38147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 0x7f0a38147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60090/0 (socket says 172.21.15.42:60090) 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a37fff640 1 -- 172.21.15.42:0/3253349202 learned_addr learned my addr 172.21.15.42:0/3253349202 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a377fe640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a38071be0 0x7f0a38156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.643+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a38154b20 0x7f0a381560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a37fff640 1 -- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a38071be0 msgr2=0x7f0a38156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a37fff640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a38071be0 0x7f0a38156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a37fff640 1 -- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a38154b20 msgr2=0x7f0a381560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a37fff640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a38154b20 0x7f0a381560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a37fff640 1 -- 172.21.15.42:0/3253349202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a38156610 con 0x7f0a38147ce0 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a37fff640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 0x7f0a38147520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000caa0 tx=0x7f0a3000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a1ffff640 1 -- 172.21.15.42:0/3253349202 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000ac00 con 0x7f0a38147ce0 2024-05-09T01:41:32.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a1ffff640 1 -- 172.21.15.42:0/3253349202 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3000ada0 con 0x7f0a38147ce0 2024-05-09T01:41:32.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3815aed0 con 0x7f0a38147ce0 2024-05-09T01:41:32.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a1ffff640 1 -- 172.21.15.42:0/3253349202 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30012600 con 0x7f0a38147ce0 2024-05-09T01:41:32.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.644+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3815b490 con 0x7f0a38147ce0 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.646+0000 7f0a1ffff640 1 -- 172.21.15.42:0/3253349202 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a300127a0 con 0x7f0a38147ce0 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.647+0000 7f0a1ffff640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0a240762d0 0x7f0a240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.647+0000 7f0a1ffff640 1 -- 172.21.15.42:0/3253349202 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a30097b70 con 0x7f0a38147ce0 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.647+0000 7f0a377fe640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0a240762d0 0x7f0a240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.648+0000 7f0a44ddc740 1 Processor -- start 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.648+0000 7f0a377fe640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0a240762d0 0x7f0a240787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009560 tx=0x7f0a28009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.648+0000 7f0a44ddc740 1 -- start start 2024-05-09T01:41:32.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853ad270 0x55cc85793c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc857772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc857777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc856b54e0 con 0x55cc853843b0 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cc85650ff0 con 0x55cc853ad270 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55cc856b14a0 con 0x55cc8538c590 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc857772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc857772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60092/0 (socket says 172.21.15.42:60092) 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853ad270 0x55cc85793c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 -- 172.21.15.42:0/3545001205 learned_addr learned my addr 172.21.15.42:0/3545001205 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a37fff640 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc857777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 -- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 msgr2=0x55cc857777e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc857777e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 -- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853ad270 msgr2=0x55cc85793c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853ad270 0x55cc85793c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.649+0000 7f0a36ffd640 1 -- 172.21.15.42:0/3545001205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc85637720 con 0x55cc853843b0 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.650+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc857772a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c035040 tx=0x7f0a2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdf06f68f0a81c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.650+0000 7f0a1d7fa640 1 -- 172.21.15.42:0/3545001205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c037040 con 0x55cc853843b0 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.650+0000 7f0a1d7fa640 1 -- 172.21.15.42:0/3545001205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c044070 con 0x55cc853843b0 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.650+0000 7f0a1d7fa640 1 -- 172.21.15.42:0/3545001205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004280 con 0x55cc853843b0 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.650+0000 7f0a44ddc740 1 -- 172.21.15.42:0/3545001205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 msgr2=0x55cc857772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.650+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc857772a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c035040 tx=0x7f0a2c02c000 comp rx=0 tx=0).stop 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 -- 172.21.15.42:0/3545001205 shutdown_connections 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc857777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc857772a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/3545001205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853ad270 0x55cc85793c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 -- 172.21.15.42:0/3545001205 >> 172.21.15.42:0/3545001205 conn(0x55cc853a13c0 msgr2=0x55cc857518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 -- 172.21.15.42:0/3545001205 shutdown_connections 2024-05-09T01:41:32.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 -- 172.21.15.42:0/3545001205 wait complete. 2024-05-09T01:41:32.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.651+0000 7f0a44ddc740 1 -- start start 2024-05-09T01:41:32.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.652+0000 7f0a44ddc740 1 Processor -- start 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853843b0 0x55cc8578e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc8577bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc857a3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc85751700 con 0x55cc853ad270 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cc8563c760 con 0x55cc8538c590 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55cc857a31b0 con 0x55cc853843b0 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a44ddc740 10 client.0 _ll_register_callbacks cb 0x55cc8565f4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc857a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853843b0 0x55cc8578e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc857a3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60106/0 (socket says 172.21.15.42:60106) 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 -- 172.21.15.42:0/2426125699 learned_addr learned my addr 172.21.15.42:0/2426125699 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc8577bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 -- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853843b0 msgr2=0x55cc8578e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853843b0 0x55cc8578e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 -- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 msgr2=0x55cc8577bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc8577bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 -- 172.21.15.42:0/2426125699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8567dbd0 con 0x55cc853ad270 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc8577bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a37fff640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc857a3640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a30096000 tx=0x7f0a300612a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a716fb1b0f3c2d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.653+0000 7f0a167fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a167fc640 1 -- 172.21.15.42:0/2426125699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30060d50 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a167fc640 1 -- 172.21.15.42:0/2426125699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a3005c6c0 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a2c044070 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a167fc640 1 -- 172.21.15.42:0/2426125699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0a30080050 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 10 client.4689 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55cc85663280 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a167fc640 1 -- 172.21.15.42:0/2426125699 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c044070 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a167fc640 1 -- 172.21.15.42:0/2426125699 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f0a30093070 con 0x55cc853ad270 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 10 client.4689 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 20 client.4689 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc8536be40 0x55cc857b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 4 client.4689 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 --> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc856c30f0 con 0x55cc8536be40 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.654+0000 7f0a377fe640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc8536be40 0x55cc857b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.655+0000 7f0a167fc640 10 client.4689 ms_handle_connect on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:32.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.655+0000 7f0a377fe640 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc8536be40 0x55cc857b1b50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78f1ca69b07a84f2 server_cookie=4b315254f9649f4c in_seq=0 out_seq=0 2024-05-09T01:41:32.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.655+0000 7f0a167fc640 1 -- 172.21.15.42:0/2426125699 <== mds.2 v2:172.21.15.181:6838/2888840633 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cc856c30f0 con 0x55cc8536be40 2024-05-09T01:41:32.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.655+0000 7f0a167fc640 10 client.4689 handle_command_reply: tid=0 2024-05-09T01:41:32.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 client.4689 shutdown 2024-05-09T01:41:32.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 msgr2=0x55cc857a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc857a3640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a30096000 tx=0x7f0a300612a0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 shutdown_connections 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc8536be40 0x55cc857b1b50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc857a3640 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a167fc640 0 client.4689 ms_handle_reset on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc8577bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2426125699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853843b0 0x55cc8578e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 >> 172.21.15.42:0/2426125699 conn(0x55cc853a13c0 msgr2=0x55cc8574c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 shutdown_connections 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2426125699 wait complete. 2024-05-09T01:41:32.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.656+0000 7f0a44ddc740 20 client.4689 trim_cache size 0 max 16384 2024-05-09T01:41:32.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.675+0000 7f0a44ddc740 1 Processor -- start 2024-05-09T01:41:32.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.675+0000 7f0a44ddc740 1 -- start start 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853843b0 0x55cc857541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc8574d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc8574d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381f4070 con 0x55cc853ad270 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cc8578c780 con 0x55cc853843b0 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55cc85750400 con 0x55cc8538c590 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc8574d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc8574d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60122/0 (socket says 172.21.15.42:60122) 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 -- 172.21.15.42:0/2554019375 learned_addr learned my addr 172.21.15.42:0/2554019375 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc8574d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a377fe640 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853843b0 0x55cc857541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 -- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 msgr2=0x55cc8574d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc8574d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 -- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853843b0 msgr2=0x55cc857541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853843b0 0x55cc857541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 -- 172.21.15.42:0/2554019375 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc85418850 con 0x55cc853ad270 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a37fff640 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc8574d8e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a30060ce0 tx=0x7f0a30007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c434f23dd1d920 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a1cff9640 1 -- 172.21.15.42:0/2554019375 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3006e070 con 0x55cc853ad270 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a1cff9640 1 -- 172.21.15.42:0/2554019375 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a30060d50 con 0x55cc853ad270 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.677+0000 7f0a1cff9640 1 -- 172.21.15.42:0/2554019375 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30069b00 con 0x55cc853ad270 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2554019375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 msgr2=0x55cc8574d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc8574d8e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a30060ce0 tx=0x7f0a30007000 comp rx=0 tx=0).stop 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2554019375 shutdown_connections 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853ad270 0x55cc8574d8e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc8538c590 0x55cc8574d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/2554019375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc853843b0 0x55cc857541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2554019375 >> 172.21.15.42:0/2554019375 conn(0x55cc853a13c0 msgr2=0x55cc85790790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2554019375 shutdown_connections 2024-05-09T01:41:32.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.678+0000 7f0a44ddc740 1 -- 172.21.15.42:0/2554019375 wait complete. 2024-05-09T01:41:32.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.679+0000 7f0a44ddc740 1 -- start start 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.679+0000 7f0a44ddc740 1 Processor -- start 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc8580dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc85771850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853ad270 0x55cc8574d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc85774e50 con 0x55cc853843b0 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cc857a6fc0 con 0x55cc8538c590 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55cc8578b5e0 con 0x55cc853ad270 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.680+0000 7f0a44ddc740 10 client.0 _ll_register_callbacks cb 0x7f0a3000af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc8580dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc8580dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60132/0 (socket says 172.21.15.42:60132) 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 -- 172.21.15.42:0/4266050121 learned_addr learned my addr 172.21.15.42:0/4266050121 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc85771850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a37fff640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853ad270 0x55cc8574d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 -- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853ad270 msgr2=0x55cc8574d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853ad270 0x55cc8574d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 -- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 msgr2=0x55cc85771850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc85771850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 -- 172.21.15.42:0/4266050121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8548f6b0 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a377fe640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc8580dac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55cc8574c4d0 tx=0x7f0a28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7597a19215842b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a167fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a167fc640 1 -- 172.21.15.42:0/4266050121 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2802f070 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a167fc640 1 -- 172.21.15.42:0/4266050121 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a28003c70 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a30060d50 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a167fc640 1 -- 172.21.15.42:0/4266050121 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0a2803b050 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a44ddc740 10 client.4695 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.681+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55cc85671630 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a167fc640 1 -- 172.21.15.42:0/4266050121 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a30060d50 con 0x55cc853843b0 2024-05-09T01:41:32.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a167fc640 1 -- 172.21.15.42:0/4266050121 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f0a28020040 con 0x55cc853843b0 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a44ddc740 10 client.4695 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a44ddc740 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a44ddc740 20 client.4695 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc857894d0 0x55cc8581cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a44ddc740 4 client.4695 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 --> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] -- command(tid 0: {"prefix": "status"}) -- 0x55cc856bcf60 con 0x55cc857894d0 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc857894d0 0x55cc8581cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a167fc640 10 client.4695 ms_handle_connect on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.682+0000 7f0a36ffd640 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc857894d0 0x55cc8581cd80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9c096c2ded4bcce server_cookie=1523238d975a06bc in_seq=0 out_seq=0 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a167fc640 1 -- 172.21.15.42:0/4266050121 <== mds.2 v2:172.21.15.181:6838/2888840633 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55cc856bcf60 con 0x55cc857894d0 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a167fc640 10 client.4695 handle_command_reply: tid=0 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 client.4695 shutdown 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 msgr2=0x55cc8580dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc8580dac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55cc8574c4d0 tx=0x7f0a28004730 comp rx=0 tx=0).stop 2024-05-09T01:41:32.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 shutdown_connections 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55cc857894d0 0x55cc8581cd80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55cc853ad270 0x55cc8574d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc8538c590 0x55cc85771850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a167fc640 0 client.4695 ms_handle_reset on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 --2- 172.21.15.42:0/4266050121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc853843b0 0x55cc8580dac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 >> 172.21.15.42:0/4266050121 conn(0x55cc853a13c0 msgr2=0x55cc85790790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 shutdown_connections 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 1 -- 172.21.15.42:0/4266050121 wait complete. 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a44ddc740 20 client.4695 trim_cache size 0 max 16384 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:32.685 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4253, 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 22.814560611000001, 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 38.95854954 2024-05-09T01:41:32.686 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0a240762d0 msgr2=0x7f0a240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0a240762d0 0x7f0a240787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009560 tx=0x7f0a28009190 comp rx=0 tx=0).stop 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 msgr2=0x7f0a38147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 0x7f0a38147520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000caa0 tx=0x7f0a3000cf60 comp rx=0 tx=0).stop 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 shutdown_connections 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0a240762d0 0x7f0a240787e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a38147ce0 0x7f0a38147520 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a38154b20 0x7f0a381560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 --2- 172.21.15.42:0/3253349202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a38071be0 0x7f0a38156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.683+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 >> 172.21.15.42:0/3253349202 conn(0x7f0a380d0660 msgr2=0x7f0a38153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.684+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 shutdown_connections 2024-05-09T01:41:32.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.684+0000 7f0a3df27640 1 -- 172.21.15.42:0/3253349202 wait complete. 2024-05-09T01:41:32.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-09T01:41:32.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.810+0000 7feab3d38640 1 Processor -- start 2024-05-09T01:41:32.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.810+0000 7feab3d38640 1 -- start start 2024-05-09T01:41:32.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.811+0000 7feab3d38640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7feaac0ca260 0x7feaac153d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.811+0000 7feab3d38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0c6850 0x7feaac164560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.811+0000 7feab3d38640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaac159cf0 con 0x7feaac0c6440 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.811+0000 7feab3d38640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7feaac15a5b0 con 0x7feaac0ca260 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.811+0000 7feab3d38640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feaac0744e0 con 0x7feaac0c6850 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7feaac0ca260 0x7feaac153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7feaac0ca260 0x7feaac153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60148/0 (socket says 172.21.15.42:60148) 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 -- 172.21.15.42:0/4119359549 learned_addr learned my addr 172.21.15.42:0/4119359549 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab12d3640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7feaac0c6440 0x7feaac0c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33000/0 (socket says 172.21.15.42:33000) 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab22d5640 1 --2- 172.21.15.42:0/4119359549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0c6850 0x7feaac164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 -- 172.21.15.42:0/4119359549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0c6850 msgr2=0x7feaac164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 --2- 172.21.15.42:0/4119359549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0c6850 0x7feaac164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 -- 172.21.15.42:0/4119359549 >> v1:172.21.15.42:6789/0 conn(0x7feaac0c6440 legacy=0x7feaac0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab1ad4640 1 -- 172.21.15.42:0/4119359549 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac159f60 con 0x7feaac0ca260 2024-05-09T01:41:32.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.812+0000 7feab0ad2640 1 -- 172.21.15.42:0/4119359549 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114340201 0 0) 0x7feaac159cf0 con 0x7feaac0c6440 2024-05-09T01:41:32.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.813+0000 7feab1ad4640 1 --2- 172.21.15.42:0/4119359549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0ca260 0x7feaac153d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaac15a730 tx=0x7feaa802c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ec097cdd170688 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.813+0000 7feab0ad2640 1 -- 172.21.15.42:0/4119359549 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8038070 con 0x7feaac0ca260 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.813+0000 7feab0ad2640 1 -- 172.21.15.42:0/4119359549 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8031710 con 0x7feaac0ca260 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.813+0000 7feab0ad2640 1 -- 172.21.15.42:0/4119359549 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8031ae0 con 0x7feaac0ca260 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.813+0000 7feab3d38640 1 -- 172.21.15.42:0/4119359549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0ca260 msgr2=0x7feaac153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.813+0000 7feab3d38640 1 --2- 172.21.15.42:0/4119359549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0ca260 0x7feaac153d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaac15a730 tx=0x7feaa802c3d0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.814+0000 7feab3d38640 1 -- 172.21.15.42:0/4119359549 shutdown_connections 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.814+0000 7feab3d38640 1 --2- 172.21.15.42:0/4119359549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0c6850 0x7feaac164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.814+0000 7feab3d38640 1 --2- 172.21.15.42:0/4119359549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0ca260 0x7feaac153d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.814+0000 7feab3d38640 1 -- 172.21.15.42:0/4119359549 >> 172.21.15.42:0/4119359549 conn(0x7feaac06dba0 msgr2=0x7feaac06dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.814+0000 7feab3d38640 1 -- 172.21.15.42:0/4119359549 shutdown_connections 2024-05-09T01:41:32.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.814+0000 7feab3d38640 1 -- 172.21.15.42:0/4119359549 wait complete. 2024-05-09T01:41:32.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.815+0000 7feab3d38640 1 Processor -- start 2024-05-09T01:41:32.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.815+0000 7feab3d38640 1 -- start start 2024-05-09T01:41:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 0x7feaac158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feaac0c6850 0x7feaac155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0ca260 0x7feaac0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaac0c9d10 con 0x7feaac0c6440 2024-05-09T01:41:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feaac154250 con 0x7feaac0c6850 2024-05-09T01:41:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feaac0747c0 con 0x7feaac0ca260 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 0x7feaac158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 0x7feaac158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60162/0 (socket says 172.21.15.42:60162) 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 -- 172.21.15.42:0/3754061530 learned_addr learned my addr 172.21.15.42:0/3754061530 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab22d5640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0ca260 0x7feaac0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab12d3640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feaac0c6850 0x7feaac155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 -- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0ca260 msgr2=0x7feaac0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0ca260 0x7feaac0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 -- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feaac0c6850 msgr2=0x7feaac155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feaac0c6850 0x7feaac155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 -- 172.21.15.42:0/3754061530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac159d80 con 0x7feaac0c6440 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab12d3640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feaac0c6850 0x7feaac155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab1ad4640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 0x7feaac158230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feaa80090b0 tx=0x7feaa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feaa27fc640 1 -- 172.21.15.42:0/3754061530 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8038040 con 0x7feaac0c6440 2024-05-09T01:41:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feaa27fc640 1 -- 172.21.15.42:0/3754061530 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8004230 con 0x7feaac0c6440 2024-05-09T01:41:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaac1561f0 con 0x7feaac0c6440 2024-05-09T01:41:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.817+0000 7feaa27fc640 1 -- 172.21.15.42:0/3754061530 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa803d670 con 0x7feaac0c6440 2024-05-09T01:41:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.818+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaac1594e0 con 0x7feaac0c6440 2024-05-09T01:41:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.819+0000 7feaa27fc640 1 -- 172.21.15.42:0/3754061530 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feaa803b070 con 0x7feaac0c6440 2024-05-09T01:41:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.820+0000 7feaa27fc640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea90076300 0x7fea90078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.820+0000 7feaa27fc640 1 -- 172.21.15.42:0/3754061530 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feaa80b9ee0 con 0x7feaac0c6440 2024-05-09T01:41:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.820+0000 7feab12d3640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea90076300 0x7fea90078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.821+0000 7feababee740 1 Processor -- start 2024-05-09T01:41:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.821+0000 7feababee740 1 -- start start 2024-05-09T01:41:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.821+0000 7feab12d3640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea90076300 0x7fea90078810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000f60 tx=0x7fea9c007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feababee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b03320370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b0335eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feababee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b032824e0 con 0x563b02f7a270 2024-05-09T01:41:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feababee740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b0321dff0 con 0x563b02f513b0 2024-05-09T01:41:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feababee740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b0327e4a0 con 0x563b02f59590 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b03320370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b03320370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60174/0 (socket says 172.21.15.42:60174) 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 -- 172.21.15.42:0/3437707242 learned_addr learned my addr 172.21.15.42:0/3437707242 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab22d5640 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab12d3640 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b0335eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 -- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 msgr2=0x563b0335f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 -- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 msgr2=0x563b0335eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b0335eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 -- 172.21.15.42:0/3437707242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b03204720 con 0x563b02f7a270 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab22d5640 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.822+0000 7feab1ad4640 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b03320370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feaa80b8430 tx=0x7feaa8009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daa4689d551b408 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7fea8f7fe640 1 -- 172.21.15.42:0/3437707242 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa804b070 con 0x563b02f7a270 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7fea8f7fe640 1 -- 172.21.15.42:0/3437707242 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa80874f0 con 0x563b02f7a270 2024-05-09T01:41:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7fea8f7fe640 1 -- 172.21.15.42:0/3437707242 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa808bf10 con 0x563b02f7a270 2024-05-09T01:41:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 -- 172.21.15.42:0/3437707242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 msgr2=0x563b03320370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b03320370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feaa80b8430 tx=0x7feaa8009550 comp rx=0 tx=0).stop 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 -- 172.21.15.42:0/3437707242 shutdown_connections 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b0335eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 --2- 172.21.15.42:0/3437707242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b03320370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.823+0000 7feababee740 1 -- 172.21.15.42:0/3437707242 >> 172.21.15.42:0/3437707242 conn(0x563b02f6e3c0 msgr2=0x563b0331e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.824+0000 7feababee740 1 -- 172.21.15.42:0/3437707242 shutdown_connections 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.824+0000 7feababee740 1 -- 172.21.15.42:0/3437707242 wait complete. 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.824+0000 7feababee740 1 -- start start 2024-05-09T01:41:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.824+0000 7feababee740 1 Processor -- start 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 0x563b03347b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b03377010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b032824e0 con 0x563b02f513b0 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b03209760 con 0x563b02f7a270 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b033589e0 con 0x563b02f59590 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feababee740 10 client.0 _ll_register_callbacks cb 0x563b0322c4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 0x563b03347b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 0x563b03347b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60178/0 (socket says 172.21.15.42:60178) 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 -- 172.21.15.42:0/193294084 learned_addr learned my addr 172.21.15.42:0/193294084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab12d3640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab22d5640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b03377010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 -- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 msgr2=0x563b0335d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 -- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 msgr2=0x563b03377010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b03377010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 -- 172.21.15.42:0/193294084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b0324abd0 con 0x563b02f513b0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7feab1ad4640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 0x563b03347b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feaa8083180 tx=0x7feaa8009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c3fe7d1fe44fcb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7fea8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.826+0000 7fea8cff9640 1 -- 172.21.15.42:0/193294084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa808bf10 con 0x563b02f513b0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7fea8cff9640 1 -- 172.21.15.42:0/193294084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feaa808ba80 con 0x563b02f513b0 2024-05-09T01:41:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 1 -- 172.21.15.42:0/193294084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaa80874f0 con 0x563b02f513b0 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7fea8cff9640 1 -- 172.21.15.42:0/193294084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7feaa80a3050 con 0x563b02f513b0 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 10 client.4710 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 1 -- 172.21.15.42:0/193294084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563b03230280 con 0x563b02f513b0 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7fea8cff9640 1 -- 172.21.15.42:0/193294084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa80874f0 con 0x563b02f513b0 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7fea8cff9640 1 -- 172.21.15.42:0/193294084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7feaa8082450 con 0x563b02f513b0 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 10 client.4710 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 10 client.4710 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 20 client.4710 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b02f38e40 0x563b03382590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 4 client.4710 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feababee740 1 -- 172.21.15.42:0/193294084 --> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b032900f0 con 0x563b02f38e40 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.827+0000 7feab12d3640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b02f38e40 0x563b03382590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7fea8cff9640 10 client.4710 ms_handle_connect on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7feab12d3640 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b02f38e40 0x563b03382590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2094e1799aa5349 server_cookie=e39ae56c0e3050d2 in_seq=0 out_seq=0 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7fea8cff9640 1 -- 172.21.15.42:0/193294084 <== mds.1 v2:172.21.15.42:6834/1138022510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b032900f0 con 0x563b02f38e40 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7fea8cff9640 10 client.4710 handle_command_reply: tid=0 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7feababee740 1 client.4710 shutdown 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7feababee740 1 -- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 msgr2=0x563b03347b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.828+0000 7feababee740 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 0x563b03347b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feaa8083180 tx=0x7feaa8009240 comp rx=0 tx=0).stop 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 -- 172.21.15.42:0/193294084 shutdown_connections 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b03377010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b02f38e40 0x563b03382590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b0335d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 --2- 172.21.15.42:0/193294084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f513b0 0x563b03347b50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7fea8cff9640 0 client.4710 ms_handle_reset on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:32.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 -- 172.21.15.42:0/193294084 >> 172.21.15.42:0/193294084 conn(0x563b02f6e3c0 msgr2=0x563b03349580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 -- 172.21.15.42:0/193294084 shutdown_connections 2024-05-09T01:41:32.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 1 -- 172.21.15.42:0/193294084 wait complete. 2024-05-09T01:41:32.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.829+0000 7feababee740 20 client.4710 trim_cache size 0 max 16384 2024-05-09T01:41:32.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.848+0000 7feababee740 1 Processor -- start 2024-05-09T01:41:32.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.848+0000 7feababee740 1 -- start start 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b03361050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b03319d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feababee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b0331a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feababee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaac1f1e50 con 0x563b02f7a270 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feababee740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b032824e0 con 0x563b02f513b0 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feababee740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b033743e0 con 0x563b02f59590 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b0331a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b0331a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60186/0 (socket says 172.21.15.42:60186) 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 -- 172.21.15.42:0/183785710 learned_addr learned my addr 172.21.15.42:0/183785710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab1ad4640 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b03361050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab12d3640 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b03319d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 -- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 msgr2=0x563b03319d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b03319d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 -- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 msgr2=0x563b03361050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b03361050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.849+0000 7feab22d5640 1 -- 172.21.15.42:0/183785710 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b0335d890 con 0x563b02f7a270 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.850+0000 7feab22d5640 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b0331a270 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feaa40177c0 tx=0x7feaa4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4997159695b99316 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.850+0000 7fea8effd640 1 -- 172.21.15.42:0/183785710 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4003e60 con 0x563b02f7a270 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.850+0000 7fea8effd640 1 -- 172.21.15.42:0/183785710 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa4015890 con 0x563b02f7a270 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.850+0000 7fea8effd640 1 -- 172.21.15.42:0/183785710 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4015c60 con 0x563b02f7a270 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 -- 172.21.15.42:0/183785710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 msgr2=0x563b0331a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:32.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b0331a270 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feaa40177c0 tx=0x7feaa4009750 comp rx=0 tx=0).stop 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 -- 172.21.15.42:0/183785710 shutdown_connections 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f7a270 0x563b0331a270 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f59590 0x563b03319d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 --2- 172.21.15.42:0/183785710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f513b0 0x563b03361050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 -- 172.21.15.42:0/183785710 >> 172.21.15.42:0/183785710 conn(0x563b02f6e3c0 msgr2=0x563b033156e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 -- 172.21.15.42:0/183785710 shutdown_connections 2024-05-09T01:41:32.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 -- 172.21.15.42:0/183785710 wait complete. 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.851+0000 7feababee740 1 -- start start 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.852+0000 7feababee740 1 Processor -- start 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f513b0 0x563b0331e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 0x563b033dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b033dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b0335fa50 con 0x563b02f59590 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b033777e0 con 0x563b02f7a270 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b0331d490 con 0x563b02f513b0 2024-05-09T01:41:32.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feababee740 10 client.0 _ll_register_callbacks cb 0x7fea9c007430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 0x563b033dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 0x563b033dbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60198/0 (socket says 172.21.15.42:60198) 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 -- 172.21.15.42:0/87871664 learned_addr learned my addr 172.21.15.42:0/87871664 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab22d5640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b033dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab1ad4640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f513b0 0x563b0331e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 -- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f513b0 msgr2=0x563b0331e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f513b0 0x563b0331e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 -- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 msgr2=0x563b033dc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b033dc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.853+0000 7feab12d3640 1 -- 172.21.15.42:0/87871664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b03347ec0 con 0x563b02f59590 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feab12d3640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 0x563b033dbb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feaac0c5a50 tx=0x7fea9c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad976310a58a0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7fea8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7fea8cff9640 1 -- 172.21.15.42:0/87871664 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c028520 con 0x563b02f59590 2024-05-09T01:41:32.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7fea8cff9640 1 -- 172.21.15.42:0/87871664 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea9c010040 con 0x563b02f59590 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 1 -- 172.21.15.42:0/87871664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaa4015890 con 0x563b02f59590 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7fea8cff9640 1 -- 172.21.15.42:0/87871664 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fea9c037050 con 0x563b02f59590 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 10 client.4716 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 1 -- 172.21.15.42:0/87871664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563b02fe5850 con 0x563b02f59590 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7fea8cff9640 1 -- 172.21.15.42:0/87871664 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa4015890 con 0x563b02f59590 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7fea8cff9640 1 -- 172.21.15.42:0/87871664 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fea9c03a020 con 0x563b02f59590 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 10 client.4716 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 10 client.4716 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 20 client.4716 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b03364100 0x563b033ee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 4 client.4716 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feababee740 1 -- 172.21.15.42:0/87871664 --> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] -- command(tid 0: {"prefix": "status"}) -- 0x563b03289f60 con 0x563b03364100 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.854+0000 7feab1ad4640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b03364100 0x563b033ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.855+0000 7fea8cff9640 10 client.4716 ms_handle_connect on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:32.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:32.855+0000 7feab1ad4640 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b03364100 0x563b033ee610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31d0743111b75f8f server_cookie=80920615e3551223 in_seq=0 out_seq=0 2024-05-09T01:41:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7fea8cff9640 1 -- 172.21.15.42:0/87871664 <== mds.1 v2:172.21.15.42:6834/1138022510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563b03289f60 con 0x563b03364100 2024-05-09T01:41:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7fea8cff9640 10 client.4716 handle_command_reply: tid=0 2024-05-09T01:41:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 client.4716 shutdown 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 -- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 msgr2=0x563b033dbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 0x563b033dbb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feaac0c5a50 tx=0x7fea9c012000 comp rx=0 tx=0).stop 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 -- 172.21.15.42:0/87871664 shutdown_connections 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b02f7a270 0x563b033dc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b02f59590 0x563b033dbb80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x563b03364100 0x563b033ee610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 --2- 172.21.15.42:0/87871664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b02f513b0 0x563b0331e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7fea8cff9640 0 client.4716 ms_handle_reset on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 -- 172.21.15.42:0/87871664 >> 172.21.15.42:0/87871664 conn(0x563b02f6e3c0 msgr2=0x563b03360710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.699+0000 7feababee740 1 -- 172.21.15.42:0/87871664 shutdown_connections 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.700+0000 7feababee740 1 -- 172.21.15.42:0/87871664 wait complete. 2024-05-09T01:41:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.700+0000 7feababee740 20 client.4716 trim_cache size 0 max 16384 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4287, 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 28.917697924999999, 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 39.991710650999998 2024-05-09T01:41:33.699 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.700+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea90076300 msgr2=0x7fea90078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.700+0000 7feab3d38640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea90076300 0x7fea90078810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000f60 tx=0x7fea9c007cc0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.700+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 msgr2=0x7feaac158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.700+0000 7feab3d38640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 0x7feaac158230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feaa80090b0 tx=0x7feaa80046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 shutdown_connections 2024-05-09T01:41:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea90076300 0x7fea90078810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feaac0ca260 0x7feaac0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feaac0c6850 0x7feaac155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 --2- 172.21.15.42:0/3754061530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac0c6440 0x7feaac158230 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 >> 172.21.15.42:0/3754061530 conn(0x7feaac06dba0 msgr2=0x7feaac073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 shutdown_connections 2024-05-09T01:41:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.701+0000 7feab3d38640 1 -- 172.21.15.42:0/3754061530 wait complete. 2024-05-09T01:41:33.712 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-09T01:41:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.838+0000 7f0b5842b640 1 Processor -- start 2024-05-09T01:41:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.838+0000 7f0b5842b640 1 -- start start 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b5842b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 0x7f0b5015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b5842b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0b50154f30 0x7f0b5015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b5842b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b500caa10 con 0x7f0b50071be0 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b5842b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0b50071750 con 0x7f0b50154f30 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b5842b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0b500cb200 con 0x7f0b50154b20 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b561c7640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0b50071be0 0x7f0b500c5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33006/0 (socket says 172.21.15.42:33006) 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.839+0000 7f0b561c7640 1 -- 172.21.15.42:0/3310124282 learned_addr learned my addr 172.21.15.42:0/3310124282 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 0x7f0b5015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b569c8640 1 --2- 172.21.15.42:0/3310124282 >> v2:172.21.15.181:3300/0 conn(0x7f0b50154f30 0x7f0b5015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490089780 0 0) 0x7f0b500caa10 con 0x7f0b50071be0 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b3c003520 con 0x7f0b50071be0 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2097793492 0 0) 0x7f0b3c003520 con 0x7f0b50071be0 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 msgr2=0x7f0b5015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 0x7f0b5015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 >> v2:172.21.15.181:3300/0 conn(0x7f0b50154f30 msgr2=0x7f0b5015e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 --2- 172.21.15.42:0/3310124282 >> v2:172.21.15.181:3300/0 conn(0x7f0b50154f30 0x7f0b5015e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b500cb740 con 0x7f0b50071be0 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f0b4c0016f0 con 0x7f0b50071be0 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 >> v1:172.21.15.42:6789/0 conn(0x7f0b50071be0 legacy=0x7f0b500c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3c003a00 0x7f0b3c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b3c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 0x7f0b3c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50071750 con 0x7f0b3c004800 2024-05-09T01:41:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0b500cb200 con 0x7f0b3c003a00 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c00ba70 con 0x7f0b50154b20 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b3c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b561c7640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3c003a00 0x7f0b3c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.840+0000 7f0b569c8640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 0x7f0b3c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b559c6640 1 -- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 msgr2=0x7f0b3c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b50154b20 0x7f0b3c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b559c6640 1 -- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3c003a00 msgr2=0x7f0b3c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3c003a00 0x7f0b3c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b559c6640 1 -- 172.21.15.42:0/3310124282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c003520 con 0x7f0b3c004800 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b3c004c10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009ac0 tx=0x7f0b3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece2b23f7ac1c9fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40036070 con 0x7f0b3c004800 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b40031400 con 0x7f0b3c004800 2024-05-09T01:41:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.841+0000 7f0b551c5640 1 -- 172.21.15.42:0/3310124282 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40009690 con 0x7f0b3c004800 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b5842b640 1 -- 172.21.15.42:0/3310124282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 msgr2=0x7f0b3c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b5842b640 1 --2- 172.21.15.42:0/3310124282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b3c004c10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009ac0 tx=0x7f0b3c005830 comp rx=0 tx=0).stop 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b569c8640 1 -- 172.21.15.42:0/3310124282 reap_dead start 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b5842b640 1 -- 172.21.15.42:0/3310124282 shutdown_connections 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b5842b640 1 -- 172.21.15.42:0/3310124282 >> 172.21.15.42:0/3310124282 conn(0x7f0b500d0660 msgr2=0x7f0b50072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b5842b640 1 -- 172.21.15.42:0/3310124282 shutdown_connections 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.842+0000 7f0b5842b640 1 -- 172.21.15.42:0/3310124282 wait complete. 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.844+0000 7f0b5842b640 1 Processor -- start 2024-05-09T01:41:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.844+0000 7f0b5842b640 1 -- start start 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.845+0000 7f0b5842b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b501f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.845+0000 7f0b5842b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b5014a400 0x7f0b501e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.845+0000 7f0b5842b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b501e47f0 0x7f0b500ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.845+0000 7f0b5842b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b500713e0 con 0x7f0b3c004800 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.845+0000 7f0b5842b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50071100 con 0x7f0b501e47f0 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.845+0000 7f0b5842b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0b500cb970 con 0x7f0b5014a400 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b501f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b501f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60220/0 (socket says 172.21.15.42:60220) 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 -- 172.21.15.42:0/107717358 learned_addr learned my addr 172.21.15.42:0/107717358 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b569c8640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b501e47f0 0x7f0b500ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b559c6640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b5014a400 0x7f0b501e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 -- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b5014a400 msgr2=0x7f0b501e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b5014a400 0x7f0b501e6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 -- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b501e47f0 msgr2=0x7f0b500ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b501e47f0 0x7f0b500ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 -- 172.21.15.42:0/107717358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b50159cb0 con 0x7f0b3c004800 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b569c8640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b501e47f0 0x7f0b500ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b561c7640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b501f0470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0073a0 tx=0x7f0b4c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b46ffd640 1 -- 172.21.15.42:0/107717358 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01a070 con 0x7f0b3c004800 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b46ffd640 1 -- 172.21.15.42:0/107717358 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00f8e0 con 0x7f0b3c004800 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b501599d0 con 0x7f0b3c004800 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b46ffd640 1 -- 172.21.15.42:0/107717358 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00fcd0 con 0x7f0b3c004800 2024-05-09T01:41:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.846+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b50158ca0 con 0x7f0b3c004800 2024-05-09T01:41:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.848+0000 7f0b46ffd640 1 -- 172.21.15.42:0/107717358 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b4c01e3f0 con 0x7f0b3c004800 2024-05-09T01:41:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.848+0000 7f0b46ffd640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b34076300 0x7f0b34078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.849+0000 7f0b46ffd640 1 -- 172.21.15.42:0/107717358 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b4c096c60 con 0x7f0b3c004800 2024-05-09T01:41:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.849+0000 7f0b559c6640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b34076300 0x7f0b34078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.849+0000 7f0b559c6640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b34076300 0x7f0b34078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009ac0 tx=0x7f0b40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.850+0000 7f0b5f3bf740 1 Processor -- start 2024-05-09T01:41:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.850+0000 7f0b5f3bf740 1 -- start start 2024-05-09T01:41:33.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d34c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d49253b0 0x55b5d4d182a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d187e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4c564e0 con 0x55b5d494e270 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4bf1ff0 con 0x55b5d492d590 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b5d4c524a0 con 0x55b5d49253b0 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d34c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d34c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60234/0 (socket says 172.21.15.42:60234) 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b561c7640 1 -- 172.21.15.42:0/2998941318 learned_addr learned my addr 172.21.15.42:0/2998941318 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.851+0000 7f0b569c8640 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b559c6640 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d49253b0 0x55b5d4d182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b561c7640 1 -- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d49253b0 msgr2=0x55b5d4d182a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b561c7640 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d49253b0 0x55b5d4d182a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b561c7640 1 -- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 msgr2=0x55b5d4d187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b561c7640 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d187e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b561c7640 1 -- 172.21.15.42:0/2998941318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d4bd8720 con 0x55b5d494e270 2024-05-09T01:41:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b561c7640 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d34c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007370 tx=0x7f0b4c00ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d8556a723f37c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b33fff640 1 -- 172.21.15.42:0/2998941318 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0793e0 con 0x55b5d494e270 2024-05-09T01:41:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b33fff640 1 -- 172.21.15.42:0/2998941318 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c05fec0 con 0x55b5d494e270 2024-05-09T01:41:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.852+0000 7f0b33fff640 1 -- 172.21.15.42:0/2998941318 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c05f320 con 0x55b5d494e270 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/2998941318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 msgr2=0x55b5d4d34c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d34c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007370 tx=0x7f0b4c00ff30 comp rx=0 tx=0).stop 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/2998941318 shutdown_connections 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d49253b0 0x55b5d4d182a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/2998941318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d34c80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/2998941318 >> 172.21.15.42:0/2998941318 conn(0x55b5d49423c0 msgr2=0x55b5d4cf28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/2998941318 shutdown_connections 2024-05-09T01:41:33.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.853+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/2998941318 wait complete. 2024-05-09T01:41:33.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.854+0000 7f0b5f3bf740 1 -- start start 2024-05-09T01:41:33.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.854+0000 7f0b5f3bf740 1 Processor -- start 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d49253b0 0x55b5d4d1cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d2d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d143b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4cf2700 con 0x55b5d494e270 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4bdd760 con 0x55b5d49253b0 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b5d4d2e2e0 con 0x55b5d492d590 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b5f3bf740 10 client.0 _ll_register_callbacks cb 0x55b5d4c004b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b569c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b569c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d143b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60240/0 (socket says 172.21.15.42:60240) 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.855+0000 7f0b569c8640 1 -- 172.21.15.42:0/1116109661 learned_addr learned my addr 172.21.15.42:0/1116109661 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b561c7640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d49253b0 0x55b5d4d1cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b559c6640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d2d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b569c8640 1 -- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 msgr2=0x55b5d4d2d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b569c8640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d2d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b569c8640 1 -- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d49253b0 msgr2=0x55b5d4d1cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b569c8640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d49253b0 0x55b5d4d1cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b569c8640 1 -- 172.21.15.42:0/1116109661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d4c1ebd0 con 0x55b5d494e270 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b561c7640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d49253b0 0x55b5d4d1cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b569c8640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d143b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b500749c0 tx=0x7f0b480043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f83f254612714f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b317fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b317fa640 1 -- 172.21.15.42:0/1116109661 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b480167a0 con 0x55b5d494e270 2024-05-09T01:41:33.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c05fec0 con 0x55b5d494e270 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b317fa640 1 -- 172.21.15.42:0/1116109661 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b48021ae0 con 0x55b5d494e270 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b317fa640 1 -- 172.21.15.42:0/1116109661 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0b48021ce0 con 0x55b5d494e270 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b5f3bf740 10 client.4728 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b5d4c04280 con 0x55b5d494e270 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.856+0000 7f0b317fa640 1 -- 172.21.15.42:0/1116109661 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c05fec0 con 0x55b5d494e270 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b317fa640 1 -- 172.21.15.42:0/1116109661 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f0b48028050 con 0x55b5d494e270 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b5f3bf740 10 client.4728 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b5f3bf740 10 client.4728 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b5f3bf740 20 client.4728 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d490ce40 0x55b5d4d52a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b5f3bf740 4 client.4728 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5d4c640f0 con 0x55b5d490ce40 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b561c7640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d490ce40 0x55b5d4d52a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b317fa640 10 client.4728 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.857+0000 7f0b561c7640 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d490ce40 0x55b5d4d52a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f23b1ff84683811 server_cookie=ebe6c357c6ae01e7 in_seq=0 out_seq=0 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b317fa640 1 -- 172.21.15.42:0/1116109661 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b5d4c640f0 con 0x55b5d490ce40 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b317fa640 10 client.4728 handle_command_reply: tid=0 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 client.4728 shutdown 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 msgr2=0x55b5d4d143b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d143b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b500749c0 tx=0x7f0b480043c0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 shutdown_connections 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d490ce40 0x55b5d4d52a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d494e270 0x55b5d4d143b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d2d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b317fa640 0 client.4728 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/1116109661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d49253b0 0x55b5d4d1cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 >> 172.21.15.42:0/1116109661 conn(0x55b5d49423c0 msgr2=0x55b5d4cecc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.858+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 shutdown_connections 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.859+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/1116109661 wait complete. 2024-05-09T01:41:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.859+0000 7f0b5f3bf740 20 client.4728 trim_cache size 0 max 16384 2024-05-09T01:41:33.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.877+0000 7f0b5f3bf740 1 Processor -- start 2024-05-09T01:41:33.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.877+0000 7f0b5f3bf740 1 -- start start 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d478a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d47de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d494e270 0x55b5d4cecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b501f43c0 con 0x55b5d49253b0 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4d31bf0 con 0x55b5d492d590 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b5d4d2e0c0 con 0x55b5d494e270 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60242/0 (socket says 172.21.15.42:60242) 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 -- 172.21.15.42:0/604004230 learned_addr learned my addr 172.21.15.42:0/604004230 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b559c6640 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d47de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b569c8640 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d494e270 0x55b5d4cecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 -- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d494e270 msgr2=0x55b5d4cecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d494e270 0x55b5d4cecc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 -- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 msgr2=0x55b5d4d47de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d47de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 -- 172.21.15.42:0/604004230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d49b9850 con 0x55b5d49253b0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b569c8640 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d494e270 0x55b5d4cecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b561c7640 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d478a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00ff70 tx=0x7f0b4c066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f511b4f6e6be4d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b337fe640 1 -- 172.21.15.42:0/604004230 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c068c90 con 0x55b5d49253b0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b337fe640 1 -- 172.21.15.42:0/604004230 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c05f120 con 0x55b5d49253b0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.879+0000 7f0b337fe640 1 -- 172.21.15.42:0/604004230 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c05b830 con 0x55b5d49253b0 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/604004230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 msgr2=0x55b5d4d478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d478a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00ff70 tx=0x7f0b4c066000 comp rx=0 tx=0).stop 2024-05-09T01:41:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/604004230 shutdown_connections 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d494e270 0x55b5d4cecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d492d590 0x55b5d4d47de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/604004230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d478a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/604004230 >> 172.21.15.42:0/604004230 conn(0x55b5d49423c0 msgr2=0x55b5d4ced970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/604004230 shutdown_connections 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.880+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/604004230 wait complete. 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.881+0000 7f0b5f3bf740 1 -- start start 2024-05-09T01:41:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.881+0000 7f0b5f3bf740 1 Processor -- start 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d3d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d1b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d494e270 0x55b5d4d4ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4d14bf0 con 0x55b5d49253b0 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b5d4d43fa0 con 0x55b5d494e270 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b5d4d2b5f0 con 0x55b5d492d590 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b5f3bf740 10 client.0 _ll_register_callbacks cb 0x7f0b48009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.882+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d3d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d3d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60250/0 (socket says 172.21.15.42:60250) 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 -- 172.21.15.42:0/3231220755 learned_addr learned my addr 172.21.15.42:0/3231220755 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b569c8640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d494e270 0x55b5d4d4ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d1b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 -- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 msgr2=0x55b5d4d1b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d1b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 -- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d494e270 msgr2=0x55b5d4d4ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d494e270 0x55b5d4d4ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 -- 172.21.15.42:0/3231220755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d4a306b0 con 0x55b5d49253b0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b569c8640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d494e270 0x55b5d4d4ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d1b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b561c7640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d3d210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c05d130 tx=0x7f0b4c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda06736653ac45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b317fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b317fa640 1 -- 172.21.15.42:0/3231220755 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c05ba30 con 0x55b5d49253b0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b317fa640 1 -- 172.21.15.42:0/3231220755 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b4c05eb90 con 0x55b5d49253b0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c05f120 con 0x55b5d49253b0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b317fa640 1 -- 172.21.15.42:0/3231220755 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0b4c05fec0 con 0x55b5d49253b0 2024-05-09T01:41:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b5f3bf740 10 client.4734 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b5d4c12630 con 0x55b5d49253b0 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.883+0000 7f0b317fa640 1 -- 172.21.15.42:0/3231220755 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c05f120 con 0x55b5d49253b0 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b317fa640 1 -- 172.21.15.42:0/3231220755 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f0b4c05ed90 con 0x55b5d49253b0 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 10 client.4734 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 20 client.4734 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d4d49990 0x55b5d4d49da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 4 client.4734 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "status"}) -- 0x55b5d4c5df60 con 0x55b5d4d49990 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d4d49990 0x55b5d4d49da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b317fa640 10 client.4734 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b559c6640 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d4d49990 0x55b5d4d49da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e406a2c34f4dda4 server_cookie=bb98aacfd98c9dbe in_seq=0 out_seq=0 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b317fa640 1 -- 172.21.15.42:0/3231220755 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b5d4c5df60 con 0x55b5d4d49990 2024-05-09T01:41:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b317fa640 10 client.4734 handle_command_reply: tid=0 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.884+0000 7f0b5f3bf740 1 client.4734 shutdown 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 msgr2=0x55b5d4d3d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d3d210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c05d130 tx=0x7f0b4c016040 comp rx=0 tx=0).stop 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 shutdown_connections 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55b5d4d49990 0x55b5d4d49da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5d494e270 0x55b5d4d4ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5d492d590 0x55b5d4d1b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 --2- 172.21.15.42:0/3231220755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5d49253b0 0x55b5d4d3d210 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b317fa640 0 client.4734 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 >> 172.21.15.42:0/3231220755 conn(0x55b5d49423c0 msgr2=0x55b5d4ced970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 shutdown_connections 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 1 -- 172.21.15.42:0/3231220755 wait complete. 2024-05-09T01:41:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5f3bf740 20 client.4734 trim_cache size 0 max 16384 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4311, 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 34.150021721000002, 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:33.890 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 40.161600122000003 2024-05-09T01:41:33.891 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b34076300 msgr2=0x7f0b34078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b34076300 0x7f0b34078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009ac0 tx=0x7f0b40008030 comp rx=0 tx=0).stop 2024-05-09T01:41:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 msgr2=0x7f0b501f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b501f0470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0073a0 tx=0x7f0b4c007860 comp rx=0 tx=0).stop 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 shutdown_connections 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0b34076300 0x7f0b34078810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b501e47f0 0x7f0b500ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b5014a400 0x7f0b501e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 --2- 172.21.15.42:0/107717358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b3c004800 0x7f0b501f0470 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.885+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 >> 172.21.15.42:0/107717358 conn(0x7f0b500d0660 msgr2=0x7f0b50152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.886+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 shutdown_connections 2024-05-09T01:41:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:33.886+0000 7f0b5842b640 1 -- 172.21.15.42:0/107717358 wait complete. 2024-05-09T01:41:33.894 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T01:41:33.903 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T01:41:33.903 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T01:41:33.904 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T01:41:33.904 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-09T01:41:33.928 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-09T01:41:33.928 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-09T01:41:33.928 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-09T01:41:33.928 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T01:41:33.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:33.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:33.929 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-05-09T01:41:33.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:33.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-05-09T01:41:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-05-09T01:41:34.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:41:34.014 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-09T01:41:34.015 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T01:41:34.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.172+0000 7f5628b27640 1 Processor -- start 2024-05-09T01:41:34.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.172+0000 7f5628b27640 1 -- start start 2024-05-09T01:41:34.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5628b27640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56240c9500 0x7f56240ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:34.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5628b27640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f56240b7ba0 0x7f56241570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:34.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5628b27640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5624160420 con 0x7f56240c9a80 2024-05-09T01:41:34.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5628b27640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f56241612f0 con 0x7f56240b7ba0 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5628b27640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f56240cc350 con 0x7f56240c9500 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5619d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f56240b7ba0 0x7f56241570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5619d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f56240b7ba0 0x7f56241570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60258/0 (socket says 172.21.15.42:60258) 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.173+0000 7f5619d9b640 1 -- 172.21.15.42:0/2355843777 learned_addr learned my addr 172.21.15.42:0/2355843777 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.174+0000 7f562259c640 1 --2- 172.21.15.42:0/2355843777 >> v2:172.21.15.181:3300/0 conn(0x7f56240c9500 0x7f56240ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.174+0000 7f5619d9b640 1 -- 172.21.15.42:0/2355843777 >> v2:172.21.15.181:3300/0 conn(0x7f56240c9500 msgr2=0x7f56240ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.174+0000 7f5619d9b640 1 --2- 172.21.15.42:0/2355843777 >> v2:172.21.15.181:3300/0 conn(0x7f56240c9500 0x7f56240ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.174+0000 7f5619d9b640 1 -- 172.21.15.42:0/2355843777 >> v1:172.21.15.181:6789/0 conn(0x7f56240c9a80 legacy=0x7f56240ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.174+0000 7f5619d9b640 1 -- 172.21.15.42:0/2355843777 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56241606e0 con 0x7f56240b7ba0 2024-05-09T01:41:34.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.174+0000 7f5619d9b640 1 --2- 172.21.15.42:0/2355843777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240b7ba0 0x7f56241570f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f56240ccf50 tx=0x7f560c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8219963ab4dfee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:34.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5621d9b640 1 -- 172.21.15.42:0/2355843777 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c037070 con 0x7f56240b7ba0 2024-05-09T01:41:34.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5621d9b640 1 -- 172.21.15.42:0/2355843777 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c032440 con 0x7f56240b7ba0 2024-05-09T01:41:34.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5621d9b640 1 -- 172.21.15.42:0/2355843777 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c032810 con 0x7f56240b7ba0 2024-05-09T01:41:34.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 -- 172.21.15.42:0/2355843777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240b7ba0 msgr2=0x7f56241570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:34.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 --2- 172.21.15.42:0/2355843777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240b7ba0 0x7f56241570f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f56240ccf50 tx=0x7f560c02a1e0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 -- 172.21.15.42:0/2355843777 shutdown_connections 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 --2- 172.21.15.42:0/2355843777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240b7ba0 0x7f56241570f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 --2- 172.21.15.42:0/2355843777 >> v2:172.21.15.181:3300/0 conn(0x7f56240c9500 0x7f56240ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 -- 172.21.15.42:0/2355843777 >> 172.21.15.42:0/2355843777 conn(0x7f56240d2100 msgr2=0x7f56240d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 -- 172.21.15.42:0/2355843777 shutdown_connections 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.175+0000 7f5628b27640 1 -- 172.21.15.42:0/2355843777 wait complete. 2024-05-09T01:41:34.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.177+0000 7f5628b27640 1 Processor -- start 2024-05-09T01:41:34.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.177+0000 7f5628b27640 1 -- start start 2024-05-09T01:41:34.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56240b7ba0 0x7f56241e8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:34.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 0x7f56241f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:34.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56240c9a80 0x7f562415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:34.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5624160f80 con 0x7f56240c9500 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5624160ca0 con 0x7f56240b7ba0 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f56240caf80 con 0x7f56240c9a80 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 0x7f56241f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 0x7f56241f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60262/0 (socket says 172.21.15.42:60262) 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 -- 172.21.15.42:0/1299648062 learned_addr learned my addr 172.21.15.42:0/1299648062 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f562259c640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56240b7ba0 0x7f56241e8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5622d9d640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56240c9a80 0x7f562415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 -- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56240c9a80 msgr2=0x7f562415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56240c9a80 0x7f562415f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 -- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56240b7ba0 msgr2=0x7f56241e8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:34.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56240b7ba0 0x7f56241e8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 -- 172.21.15.42:0/1299648062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56240d1e10 con 0x7f56240c9500 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5619d9b640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 0x7f56241f30c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f560c000c00 tx=0x7f560c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c041020 con 0x7f56240c9500 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c0306c0 con 0x7f56240c9500 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56241f3e50 con 0x7f56240c9500 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c037040 con 0x7f56240c9500 2024-05-09T01:41:34.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.179+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241f6b30 con 0x7f56240c9500 2024-05-09T01:41:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.181+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56241e9210 con 0x7f56240c9500 2024-05-09T01:41:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.181+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f560c044020 con 0x7f56240c9500 2024-05-09T01:41:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.182+0000 7f561b7fe640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56040762d0 0x7f56040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.182+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f560c0b7ef0 con 0x7f56240c9500 2024-05-09T01:41:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.182+0000 7f562259c640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56040762d0 0x7f56040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.182+0000 7f562259c640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56040762d0 0x7f56040787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5614006fd0 tx=0x7f5614008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:34.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.186+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f560c04b030 con 0x7f56240c9500 2024-05-09T01:41:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.420+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56240d26b0 con 0x7f56240c9500 2024-05-09T01:41:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.420+0000 7f561b7fe640 1 -- 172.21.15.42:0/1299648062 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f560c0817c0 con 0x7f56240c9500 2024-05-09T01:41:34.418 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T01:41:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56040762d0 msgr2=0x7f56040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56040762d0 0x7f56040787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5614006fd0 tx=0x7f5614008040 comp rx=0 tx=0).stop 2024-05-09T01:41:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 msgr2=0x7f56241f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 0x7f56241f30c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f560c000c00 tx=0x7f560c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 shutdown_connections 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f56040762d0 0x7f56040787e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56240c9a80 0x7f562415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56240c9500 0x7f56241f30c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 --2- 172.21.15.42:0/1299648062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56240b7ba0 0x7f56241e8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 >> 172.21.15.42:0/1299648062 conn(0x7f56240d2100 msgr2=0x7f56240cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 shutdown_connections 2024-05-09T01:41:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34.423+0000 7f5628b27640 1 -- 172.21.15.42:0/1299648062 wait complete. 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T01:41:34.432 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T01:41:34.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:34.433 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-05-09T01:41:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42477sec preferred_lft 42477sec 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-05-09T01:41:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-05-09T01:41:34.451 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T01:41:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-05-09T01:41:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-05-09T01:41:34.451 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T01:41:34.451 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:41:34.451 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-05-09T01:41:34.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-05-09T01:41:34.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-05-09T01:41:34.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-05-09T01:41:34.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T01:41:34.452 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-05-09T01:41:34.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:41:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:41:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:34.641 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T01:41:34.667 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-05-09T01:41:34.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:34.671 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-05-09T01:41:34.743 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-05-09T01:41:34.743 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T01:41:34.743 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-09T01:41:34.743 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-09T01:41:34.743 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T01:41:34.744 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:41:34.744 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-05-09T01:41:34.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-09T01:41:34.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-09T01:41:34.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-09T01:41:34.744 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-05-09T01:41:34.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:41:35.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:41:35.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:35.052 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-05-09T01:41:35.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:35.070 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-05-09T01:41:35.126 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:41:35.126 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-05-09T01:41:35.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T01:41:35.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T01:41:35.126 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-05-09T01:41:35.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:41:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:41:35.247 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T01:41:35.247 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-05-09T01:41:35.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:41:35.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:41:35.380 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:41:35.380 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-05-09T01:41:35.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-05-09T01:41:35.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T01:41:35.380 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-05-09T01:41:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:41:35.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:41:35.461 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-09T01:41:35.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T01:41:35.461 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:35.492 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T01:41:35.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T01:41:35.492 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:35.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2024-05-09T01:41:35.616 DEBUG:teuthology.orchestra.run.smithi042:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T01:41:35.673 INFO:teuthology.orchestra.run.smithi042.stdout:/proc 2024-05-09T01:41:35.673 INFO:teuthology.orchestra.run.smithi042.stdout:/sys 2024-05-09T01:41:35.673 INFO:teuthology.orchestra.run.smithi042.stdout:/dev 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/security 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/shm 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/pts 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/run 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/cgroup 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/pstore 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/bpf 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/ 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/selinux 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/mqueue 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/hugepages 2024-05-09T01:41:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/debug 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/tracing 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/fuse/connections 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/config 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/1000 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph 2024-05-09T01:41:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T01:41:35.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:35.676 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2024-05-09T01:41:35.730 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T01:41:35.730 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-09T01:41:35.772 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2024-05-09T01:41:35.799 DEBUG:teuthology.orchestra.run.smithi042:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T01:41:35.857 INFO:teuthology.orchestra.run.smithi042.stdout:/proc 2024-05-09T01:41:35.857 INFO:teuthology.orchestra.run.smithi042.stdout:/sys 2024-05-09T01:41:35.857 INFO:teuthology.orchestra.run.smithi042.stdout:/dev 2024-05-09T01:41:35.857 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/security 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/shm 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/pts 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/run 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/cgroup 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/pstore 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/bpf 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/ 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/selinux 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/mqueue 2024-05-09T01:41:35.858 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/hugepages 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/debug 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/tracing 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/fuse/connections 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/config 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/1000 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph 2024-05-09T01:41:35.859 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T01:41:35.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:35.860 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2024-05-09T01:41:35.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:2024-05-09T01:41:35.877+0000 7f7ef6530480 -1 init, newargv = 0x7f7ed8001080 newargc=15 2024-05-09T01:41:35.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:ceph-fuse[43375]: starting ceph client 2024-05-09T01:41:35.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:ceph-fuse[43375]: starting fuse 2024-05-09T01:41:35.892 INFO:teuthology.orchestra.run.smithi042.stdout:40 2024-05-09T01:41:35.892 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-09T01:41:35.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo stdin-killer -- python3 -c ' 2024-05-09T01:41:35.892 DEBUG:teuthology.orchestra.run.smithi042:> import glob 2024-05-09T01:41:35.892 DEBUG:teuthology.orchestra.run.smithi042:> import re 2024-05-09T01:41:35.892 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-05-09T01:41:35.892 DEBUG:teuthology.orchestra.run.smithi042:> import subprocess 2024-05-09T01:41:35.892 DEBUG:teuthology.orchestra.run.smithi042:> 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> def _find_admin_socket(client_name): 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> files = glob.glob(asok_path) 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> # Given a non-glob path, it better be there 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> if "*" not in asok_path: 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> assert(len(files) == 1) 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> return files[0] 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> 2024-05-09T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi042:> for f in files: 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> contents = proc_f.read() 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> if mountpoint in contents: 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> return f 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> print(_find_admin_socket("client.0")) 2024-05-09T01:41:35.894 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-05-09T01:41:36.013 INFO:teuthology.orchestra.run.smithi042.stdout:/var/run/ceph/ceph-client.0.43375.asok 2024-05-09T01:41:36.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:41:36.025 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43375.asok 2024-05-09T01:41:36.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:36.025 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43375.asok status 2024-05-09T01:41:36.172 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "metadata": { 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_sha1": "c9da4049f638c0f84bdd9b4e33c42e86046ac554", 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "entity_id": "0", 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": "smithi042", 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "pid": "43375", 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "root": "/" 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:41:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_count": 0, 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_pinned_count": 0, 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4749, 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "inst": { 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "name": { 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "client", 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "num": 4749 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3614520761 2024-05-09T01:41:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3614520761 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "inst_str": "client.4749 192.168.0.1:0/3614520761", 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "addr_str": "192.168.0.1:0/3614520761", 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "inode_count": 1, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_epoch": 16, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch": 21, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch_barrier": 0, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "blocklisted": false, 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs" 2024-05-09T01:41:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:36.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:36.182 DEBUG:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2024-05-09T01:41:36.182 DEBUG:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:36.198 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2024-05-09T01:41:36.198 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:36.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:41:36.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:36.266 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-09T01:41:36.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T01:41:36.280 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:36.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.424+0000 7fc3163f3640 1 Processor -- start 2024-05-09T01:41:36.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.424+0000 7fc3163f3640 1 -- start start 2024-05-09T01:41:36.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc3163f3640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3100cdaa0 0x7fc310157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc3163f3640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3100c7bf0 con 0x7fc3100ce4e0 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc3163f3640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3100c7ed0 con 0x7fc3100ce0d0 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc3163f3640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc3100ce8f0 con 0x7fc3100cdaa0 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc30ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3100cdaa0 0x7fc310157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc314990640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc3100ce4e0 0x7fc3100ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33012/0 (socket says 172.21.15.42:33012) 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc314990640 1 -- 172.21.15.42:0/2595900048 learned_addr learned my addr 172.21.15.42:0/2595900048 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc30ffff640 1 -- 172.21.15.42:0/2595900048 >> v1:172.21.15.181:6789/0 conn(0x7fc3100ce0d0 legacy=0x7fc310160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc30ffff640 1 -- 172.21.15.42:0/2595900048 >> v1:172.21.15.42:6789/0 conn(0x7fc3100ce4e0 legacy=0x7fc3100ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.426+0000 7fc30ffff640 1 -- 172.21.15.42:0/2595900048 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3100c81b0 con 0x7fc3100cdaa0 2024-05-09T01:41:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.427+0000 7fc30ffff640 1 --2- 172.21.15.42:0/2595900048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100cdaa0 0x7fc310157100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097a0 tx=0x7fc30002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e441eab3b6417c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.427+0000 7fc30effd640 1 -- 172.21.15.42:0/2595900048 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300037070 con 0x7fc3100cdaa0 2024-05-09T01:41:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.427+0000 7fc30effd640 1 -- 172.21.15.42:0/2595900048 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc300032440 con 0x7fc3100cdaa0 2024-05-09T01:41:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.427+0000 7fc30effd640 1 -- 172.21.15.42:0/2595900048 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300032810 con 0x7fc3100cdaa0 2024-05-09T01:41:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 -- 172.21.15.42:0/2595900048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100cdaa0 msgr2=0x7fc310157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2595900048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100cdaa0 0x7fc310157100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097a0 tx=0x7fc30002a230 comp rx=0 tx=0).stop 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 -- 172.21.15.42:0/2595900048 shutdown_connections 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2595900048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100cdaa0 0x7fc310157100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 -- 172.21.15.42:0/2595900048 >> 172.21.15.42:0/2595900048 conn(0x7fc310068610 msgr2=0x7fc310068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 -- 172.21.15.42:0/2595900048 shutdown_connections 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.428+0000 7fc3163f3640 1 -- 172.21.15.42:0/2595900048 wait complete. 2024-05-09T01:41:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.429+0000 7fc3163f3640 1 Processor -- start 2024-05-09T01:41:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.430+0000 7fc3163f3640 1 -- start start 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc3163f3640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3100cdaa0 0x7fc31015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc3163f3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3100ce0d0 0x7fc3100c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc3163f3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 0x7fc3100d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc3163f3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc3100c8770 con 0x7fc3100ce4e0 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc3163f3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc3100c79a0 con 0x7fc3100ce0d0 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc3163f3640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc310160470 con 0x7fc3100cdaa0 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 0x7fc3100d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 0x7fc3100d11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60288/0 (socket says 172.21.15.42:60288) 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 -- 172.21.15.42:0/2491110671 learned_addr learned my addr 172.21.15.42:0/2491110671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc30ffff640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3100cdaa0 0x7fc31015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc30f7fe640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3100ce0d0 0x7fc3100c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 -- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3100cdaa0 msgr2=0x7fc31015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3100cdaa0 0x7fc31015ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 -- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3100ce0d0 msgr2=0x7fc3100c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3100ce0d0 0x7fc3100c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.431+0000 7fc314990640 1 -- 172.21.15.42:0/2491110671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31015f360 con 0x7fc3100ce4e0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.432+0000 7fc314990640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 0x7fc3100d11a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc30800cab0 tx=0x7fc30800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.432+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308017070 con 0x7fc3100ce4e0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.432+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30800ac30 con 0x7fc3100ce4e0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.432+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3101f34a0 con 0x7fc3100ce4e0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.432+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308012400 con 0x7fc3100ce4e0 2024-05-09T01:41:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.432+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3101f3a60 con 0x7fc3100ce4e0 2024-05-09T01:41:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.433+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3100cc430 con 0x7fc3100ce4e0 2024-05-09T01:41:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.434+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc30801a070 con 0x7fc3100ce4e0 2024-05-09T01:41:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.434+0000 7fc30cff9640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fc2fc0762d0 0x7fc2fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.435+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc308097210 con 0x7fc3100ce4e0 2024-05-09T01:41:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.435+0000 7fc30ffff640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fc2fc0762d0 0x7fc2fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.435+0000 7fc30ffff640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fc2fc0762d0 0x7fc2fc0787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc300034000 tx=0x7fc30002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:36.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.440+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3100cc430 con 0x7fc3100ce4e0 2024-05-09T01:41:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.627+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3100c74e0 con 0x7fc2fc0762d0 2024-05-09T01:41:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.634+0000 7fc30cff9640 1 -- 172.21.15.42:0/2491110671 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251963 (secure 0 0 0) 0x7fc3100c74e0 con 0x7fc2fc0762d0 2024-05-09T01:41:36.635 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fc2fc0762d0 msgr2=0x7fc2fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fc2fc0762d0 0x7fc2fc0787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc300034000 tx=0x7fc30002e000 comp rx=0 tx=0).stop 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 msgr2=0x7fc3100d11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 0x7fc3100d11a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc30800cab0 tx=0x7fc30800cf70 comp rx=0 tx=0).stop 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 shutdown_connections 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fc2fc0762d0 0x7fc2fc0787e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3100ce4e0 0x7fc3100d11a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3100ce0d0 0x7fc3100c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 --2- 172.21.15.42:0/2491110671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3100cdaa0 0x7fc31015ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 >> 172.21.15.42:0/2491110671 conn(0x7fc310068610 msgr2=0x7fc310155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 shutdown_connections 2024-05-09T01:41:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.638+0000 7fc3163f3640 1 -- 172.21.15.42:0/2491110671 wait complete. 2024-05-09T01:41:36.646 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-09T01:41:36.221331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":305,"num_write_kb":1690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239976,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734744,"statfs":{"total":773094113280,"available":772848377856,"internally_reserved":0,"allocated":3121152,"data_stored":1784444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396949+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:41:01.396949+0000","last_peered":"2024-05-09T01:41:01.396949+0000","last_clean":"2024-05-09T01:41:01.396949+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:41:01.396949+0000","last_undegraded":"2024-05-09T01:41:01.396949+0000","last_fullsized":"2024-05-09T01:41:01.396949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397106+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:41:01.397106+0000","last_peered":"2024-05-09T01:41:01.397106+0000","last_clean":"2024-05-09T01:41:01.397106+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:41:01.397106+0000","last_undegraded":"2024-05-09T01:41:01.397106+0000","last_fullsized":"2024-05-09T01:41:01.397106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397038+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:41:01.397038+0000","last_peered":"2024-05-09T01:41:01.397038+0000","last_clean":"2024-05-09T01:41:01.397038+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:41:01.397038+0000","last_undegraded":"2024-05-09T01:41:01.397038+0000","last_fullsized":"2024-05-09T01:41:01.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396661+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:41:01.396661+0000","last_peered":"2024-05-09T01:41:01.396661+0000","last_clean":"2024-05-09T01:41:01.396661+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:41:01.396661+0000","last_undegraded":"2024-05-09T01:41:01.396661+0000","last_fullsized":"2024-05-09T01:41:01.396661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397057+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:41:01.397057+0000","last_peered":"2024-05-09T01:41:01.397057+0000","last_clean":"2024-05-09T01:41:01.397057+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:41:01.397057+0000","last_undegraded":"2024-05-09T01:41:01.397057+0000","last_fullsized":"2024-05-09T01:41:01.397057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396811+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:41:01.396811+0000","last_peered":"2024-05-09T01:41:01.396811+0000","last_clean":"2024-05-09T01:41:01.396811+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:41:01.396811+0000","last_undegraded":"2024-05-09T01:41:01.396811+0000","last_fullsized":"2024-05-09T01:41:01.396811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396364+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:41:01.396364+0000","last_peered":"2024-05-09T01:41:01.396364+0000","last_clean":"2024-05-09T01:41:01.396364+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:41:01.396364+0000","last_undegraded":"2024-05-09T01:41:01.396364+0000","last_fullsized":"2024-05-09T01:41:01.396364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:42.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396374+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:41:01.396374+0000","last_peered":"2024-05-09T01:41:01.396374+0000","last_clean":"2024-05-09T01:41:01.396374+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:41:01.396374+0000","last_undegraded":"2024-05-09T01:41:01.396374+0000","last_fullsized":"2024-05-09T01:41:01.396374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.795089+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:09.795089+0000","last_peered":"2024-05-09T01:41:09.795089+0000","last_clean":"2024-05-09T01:41:09.795089+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:09.795089+0000","last_undegraded":"2024-05-09T01:41:09.795089+0000","last_fullsized":"2024-05-09T01:41:09.795089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397053+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:41:01.397053+0000","last_peered":"2024-05-09T01:41:01.397053+0000","last_clean":"2024-05-09T01:41:01.397053+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:41:01.397053+0000","last_undegraded":"2024-05-09T01:41:01.397053+0000","last_fullsized":"2024-05-09T01:41:01.397053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845604+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:20.845604+0000","last_peered":"2024-05-09T01:41:20.845604+0000","last_clean":"2024-05-09T01:41:20.845604+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:20.845604+0000","last_undegraded":"2024-05-09T01:41:20.845604+0000","last_fullsized":"2024-05-09T01:41:20.845604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878417+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:14.878417+0000","last_peered":"2024-05-09T01:41:14.878417+0000","last_clean":"2024-05-09T01:41:14.878417+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:14.878417+0000","last_undegraded":"2024-05-09T01:41:14.878417+0000","last_fullsized":"2024-05-09T01:41:14.878417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842006+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:20.842006+0000","last_peered":"2024-05-09T01:41:20.842006+0000","last_clean":"2024-05-09T01:41:20.842006+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:20.842006+0000","last_undegraded":"2024-05-09T01:41:20.842006+0000","last_fullsized":"2024-05-09T01:41:20.842006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.802976+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:09.802976+0000","last_peered":"2024-05-09T01:41:09.802976+0000","last_clean":"2024-05-09T01:41:09.802976+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:09.802976+0000","last_undegraded":"2024-05-09T01:41:09.802976+0000","last_fullsized":"2024-05-09T01:41:09.802976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.292946+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:26.292946+0000","last_peered":"2024-05-09T01:41:26.292946+0000","last_clean":"2024-05-09T01:41:26.292946+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:26.292946+0000","last_undegraded":"2024-05-09T01:41:26.292946+0000","last_fullsized":"2024-05-09T01:41:26.292946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396844+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:41:01.396844+0000","last_peered":"2024-05-09T01:41:01.396844+0000","last_clean":"2024-05-09T01:41:01.396844+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:41:01.396844+0000","last_undegraded":"2024-05-09T01:41:01.396844+0000","last_fullsized":"2024-05-09T01:41:01.396844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.807472+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:09.807472+0000","last_peered":"2024-05-09T01:41:09.807472+0000","last_clean":"2024-05-09T01:41:09.807472+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:09.807472+0000","last_undegraded":"2024-05-09T01:41:09.807472+0000","last_fullsized":"2024-05-09T01:41:09.807472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397303+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:41:01.397303+0000","last_peered":"2024-05-09T01:41:01.397303+0000","last_clean":"2024-05-09T01:41:01.397303+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:41:01.397303+0000","last_undegraded":"2024-05-09T01:41:01.397303+0000","last_fullsized":"2024-05-09T01:41:01.397303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.290685+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:26.290685+0000","last_peered":"2024-05-09T01:41:26.290685+0000","last_clean":"2024-05-09T01:41:26.290685+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:26.290685+0000","last_undegraded":"2024-05-09T01:41:26.290685+0000","last_fullsized":"2024-05-09T01:41:26.290685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.290534+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:26.290534+0000","last_peered":"2024-05-09T01:41:26.290534+0000","last_clean":"2024-05-09T01:41:26.290534+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:26.290534+0000","last_undegraded":"2024-05-09T01:41:26.290534+0000","last_fullsized":"2024-05-09T01:41:26.290534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397056+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:41:01.397056+0000","last_peered":"2024-05-09T01:41:01.397056+0000","last_clean":"2024-05-09T01:41:01.397056+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:41:01.397056+0000","last_undegraded":"2024-05-09T01:41:01.397056+0000","last_fullsized":"2024-05-09T01:41:01.397056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.844959+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:20.844959+0000","last_peered":"2024-05-09T01:41:20.844959+0000","last_clean":"2024-05-09T01:41:20.844959+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:20.844959+0000","last_undegraded":"2024-05-09T01:41:20.844959+0000","last_fullsized":"2024-05-09T01:41:20.844959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845420+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:20.845420+0000","last_peered":"2024-05-09T01:41:20.845420+0000","last_clean":"2024-05-09T01:41:20.845420+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:20.845420+0000","last_undegraded":"2024-05-09T01:41:20.845420+0000","last_fullsized":"2024-05-09T01:41:20.845420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842360+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:20.842360+0000","last_peered":"2024-05-09T01:41:20.842360+0000","last_clean":"2024-05-09T01:41:20.842360+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:20.842360+0000","last_undegraded":"2024-05-09T01:41:20.842360+0000","last_fullsized":"2024-05-09T01:41:20.842360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744395+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:04.744395+0000","last_peered":"2024-05-09T01:41:04.744395+0000","last_clean":"2024-05-09T01:41:04.744395+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:04.744395+0000","last_undegraded":"2024-05-09T01:41:04.744395+0000","last_fullsized":"2024-05-09T01:41:04.744395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.288505+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:26.288505+0000","last_peered":"2024-05-09T01:41:26.288505+0000","last_clean":"2024-05-09T01:41:26.288505+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:26.288505+0000","last_undegraded":"2024-05-09T01:41:26.288505+0000","last_fullsized":"2024-05-09T01:41:26.288505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845679+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:20.845679+0000","last_peered":"2024-05-09T01:41:20.845679+0000","last_clean":"2024-05-09T01:41:20.845679+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:20.845679+0000","last_undegraded":"2024-05-09T01:41:20.845679+0000","last_fullsized":"2024-05-09T01:41:20.845679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845426+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:20.845426+0000","last_peered":"2024-05-09T01:41:20.845426+0000","last_clean":"2024-05-09T01:41:20.845426+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:20.845426+0000","last_undegraded":"2024-05-09T01:41:20.845426+0000","last_fullsized":"2024-05-09T01:41:20.845426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842048+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:20.842048+0000","last_peered":"2024-05-09T01:41:20.842048+0000","last_clean":"2024-05-09T01:41:20.842048+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:20.842048+0000","last_undegraded":"2024-05-09T01:41:20.842048+0000","last_fullsized":"2024-05-09T01:41:20.842048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878141+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:14.878141+0000","last_peered":"2024-05-09T01:41:14.878141+0000","last_clean":"2024-05-09T01:41:14.878141+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:14.878141+0000","last_undegraded":"2024-05-09T01:41:14.878141+0000","last_fullsized":"2024-05-09T01:41:14.878141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396340+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:41:01.396340+0000","last_peered":"2024-05-09T01:41:01.396340+0000","last_clean":"2024-05-09T01:41:01.396340+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:41:01.396340+0000","last_undegraded":"2024-05-09T01:41:01.396340+0000","last_fullsized":"2024-05-09T01:41:01.396340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878357+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:41:14.878357+0000","last_peered":"2024-05-09T01:41:14.878357+0000","last_clean":"2024-05-09T01:41:14.878357+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:41:14.878357+0000","last_undegraded":"2024-05-09T01:41:14.878357+0000","last_fullsized":"2024-05-09T01:41:14.878357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.292599+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:26.292599+0000","last_peered":"2024-05-09T01:41:26.292599+0000","last_clean":"2024-05-09T01:41:26.292599+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:26.292599+0000","last_undegraded":"2024-05-09T01:41:26.292599+0000","last_fullsized":"2024-05-09T01:41:26.292599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397342+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:41:01.397342+0000","last_peered":"2024-05-09T01:41:01.397342+0000","last_clean":"2024-05-09T01:41:01.397342+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:41:01.397342+0000","last_undegraded":"2024-05-09T01:41:01.397342+0000","last_fullsized":"2024-05-09T01:41:01.397342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.225830+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:01.225830+0000","last_peered":"2024-05-09T01:41:01.225830+0000","last_clean":"2024-05-09T01:41:01.225830+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:01.225830+0000","last_undegraded":"2024-05-09T01:41:01.225830+0000","last_fullsized":"2024-05-09T01:41:01.225830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842733+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:20.842733+0000","last_peered":"2024-05-09T01:41:20.842733+0000","last_clean":"2024-05-09T01:41:20.842733+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:20.842733+0000","last_undegraded":"2024-05-09T01:41:20.842733+0000","last_fullsized":"2024-05-09T01:41:20.842733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845580+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:20.845580+0000","last_peered":"2024-05-09T01:41:20.845580+0000","last_clean":"2024-05-09T01:41:20.845580+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:20.845580+0000","last_undegraded":"2024-05-09T01:41:20.845580+0000","last_fullsized":"2024-05-09T01:41:20.845580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293245+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:26.293245+0000","last_peered":"2024-05-09T01:41:26.293245+0000","last_clean":"2024-05-09T01:41:26.293245+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:26.293245+0000","last_undegraded":"2024-05-09T01:41:26.293245+0000","last_fullsized":"2024-05-09T01:41:26.293245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397004+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:41:01.397004+0000","last_peered":"2024-05-09T01:41:01.397004+0000","last_clean":"2024-05-09T01:41:01.397004+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:41:01.397004+0000","last_undegraded":"2024-05-09T01:41:01.397004+0000","last_fullsized":"2024-05-09T01:41:01.397004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.792876+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:09.792876+0000","last_peered":"2024-05-09T01:41:09.792876+0000","last_clean":"2024-05-09T01:41:09.792876+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:09.792876+0000","last_undegraded":"2024-05-09T01:41:09.792876+0000","last_fullsized":"2024-05-09T01:41:09.792876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396902+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:41:01.396902+0000","last_peered":"2024-05-09T01:41:01.396902+0000","last_clean":"2024-05-09T01:41:01.396902+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:41:01.396902+0000","last_undegraded":"2024-05-09T01:41:01.396902+0000","last_fullsized":"2024-05-09T01:41:01.396902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293405+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:26.293405+0000","last_peered":"2024-05-09T01:41:26.293405+0000","last_clean":"2024-05-09T01:41:26.293405+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:26.293405+0000","last_undegraded":"2024-05-09T01:41:26.293405+0000","last_fullsized":"2024-05-09T01:41:26.293405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842318+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:20.842318+0000","last_peered":"2024-05-09T01:41:20.842318+0000","last_clean":"2024-05-09T01:41:20.842318+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:20.842318+0000","last_undegraded":"2024-05-09T01:41:20.842318+0000","last_fullsized":"2024-05-09T01:41:20.842318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.788381+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:09.788381+0000","last_peered":"2024-05-09T01:41:09.788381+0000","last_clean":"2024-05-09T01:41:09.788381+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:09.788381+0000","last_undegraded":"2024-05-09T01:41:09.788381+0000","last_fullsized":"2024-05-09T01:41:09.788381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293030+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:26.293030+0000","last_peered":"2024-05-09T01:41:26.293030+0000","last_clean":"2024-05-09T01:41:26.293030+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:26.293030+0000","last_undegraded":"2024-05-09T01:41:26.293030+0000","last_fullsized":"2024-05-09T01:41:26.293030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'11","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293334+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:26.293334+0000","last_peered":"2024-05-09T01:41:26.293334+0000","last_clean":"2024-05-09T01:41:26.293334+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:26.293334+0000","last_undegraded":"2024-05-09T01:41:26.293334+0000","last_fullsized":"2024-05-09T01:41:26.293334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396649+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:41:01.396649+0000","last_peered":"2024-05-09T01:41:01.396649+0000","last_clean":"2024-05-09T01:41:01.396649+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:41:01.396649+0000","last_undegraded":"2024-05-09T01:41:01.396649+0000","last_fullsized":"2024-05-09T01:41:01.396649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744707+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:04.744707+0000","last_peered":"2024-05-09T01:41:04.744707+0000","last_clean":"2024-05-09T01:41:04.744707+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:04.744707+0000","last_undegraded":"2024-05-09T01:41:04.744707+0000","last_fullsized":"2024-05-09T01:41:04.744707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.295648+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:41:26.295648+0000","last_peered":"2024-05-09T01:41:26.295648+0000","last_clean":"2024-05-09T01:41:26.295648+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:41:26.295648+0000","last_undegraded":"2024-05-09T01:41:26.295648+0000","last_fullsized":"2024-05-09T01:41:26.295648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":665923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":75857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":77387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":75891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":241664,"data_stored":74917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":74987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":831488,"data_stored":664697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":74785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:36.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.805+0000 7fb0780f0640 1 Processor -- start 2024-05-09T01:41:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.805+0000 7fb0780f0640 1 -- start start 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb0780f0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb0780f0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb070165660 0x7fb070167a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb0780f0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07015cf00 con 0x7fb0700c76f0 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb0780f0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb0700ce800 con 0x7fb070165660 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb0780f0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb0700ccb30 con 0x7fb0700b4e00 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb07668d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb070165660 0x7fb070167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb075e8c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb0700c76f0 0x7fb07006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33014/0 (socket says 172.21.15.42:33014) 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb075e8c640 1 -- 172.21.15.42:0/3891420526 learned_addr learned my addr 172.21.15.42:0/3891420526 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb07568b640 1 --2- 172.21.15.42:0/3891420526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb07668d640 1 -- 172.21.15.42:0/3891420526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 msgr2=0x7fb0700cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:36.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb07668d640 1 --2- 172.21.15.42:0/3891420526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb07668d640 1 -- 172.21.15.42:0/3891420526 >> v1:172.21.15.42:6789/0 conn(0x7fb0700c76f0 legacy=0x7fb07006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb07668d640 1 -- 172.21.15.42:0/3891420526 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0700ccd80 con 0x7fb070165660 2024-05-09T01:41:36.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.807+0000 7fb074e8a640 1 -- 172.21.15.42:0/3891420526 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868673438 0 0) 0x7fb07015cf00 con 0x7fb0700c76f0 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.808+0000 7fb07668d640 1 --2- 172.21.15.42:0/3891420526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb070165660 0x7fb070167a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb060009d90 tx=0x7fb06002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8a7a92e6c41b3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.808+0000 7fb074e8a640 1 -- 172.21.15.42:0/3891420526 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060031600 con 0x7fb070165660 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.808+0000 7fb074e8a640 1 -- 172.21.15.42:0/3891420526 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0600317a0 con 0x7fb070165660 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.808+0000 7fb074e8a640 1 -- 172.21.15.42:0/3891420526 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060031b70 con 0x7fb070165660 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 -- 172.21.15.42:0/3891420526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb070165660 msgr2=0x7fb070167a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 --2- 172.21.15.42:0/3891420526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb070165660 0x7fb070167a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb060009d90 tx=0x7fb06002a5d0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 -- 172.21.15.42:0/3891420526 shutdown_connections 2024-05-09T01:41:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 --2- 172.21.15.42:0/3891420526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb070165660 0x7fb070167a80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 --2- 172.21.15.42:0/3891420526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 -- 172.21.15.42:0/3891420526 >> 172.21.15.42:0/3891420526 conn(0x7fb070068de0 msgr2=0x7fb0700d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 -- 172.21.15.42:0/3891420526 shutdown_connections 2024-05-09T01:41:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.809+0000 7fb0780f0640 1 -- 172.21.15.42:0/3891420526 wait complete. 2024-05-09T01:41:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.811+0000 7fb0780f0640 1 Processor -- start 2024-05-09T01:41:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.811+0000 7fb0780f0640 1 -- start start 2024-05-09T01:41:36.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb0780f0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb0780f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 0x7fb0701527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb0780f0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb070165660 0x7fb07014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb0780f0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0700ce4a0 con 0x7fb0700c76f0 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb0780f0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb0700cd3d0 con 0x7fb070165660 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb0780f0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb0701572c0 con 0x7fb0700b4e00 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 0x7fb0701527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 0x7fb0701527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60296/0 (socket says 172.21.15.42:60296) 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 -- 172.21.15.42:0/2975533622 learned_addr learned my addr 172.21.15.42:0/2975533622 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07668d640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb070165660 0x7fb07014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb075e8c640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 -- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 msgr2=0x7fb0700d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 -- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb070165660 msgr2=0x7fb07014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb070165660 0x7fb07014dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 -- 172.21.15.42:0/2975533622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb070152d30 con 0x7fb0700c76f0 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb075e8c640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.812+0000 7fb07568b640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 0x7fb0701527f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb06400d620 tx=0x7fb06400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.813+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06400b620 con 0x7fb0700c76f0 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.813+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064019070 con 0x7fb0700c76f0 2024-05-09T01:41:36.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.813+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0700d0b20 con 0x7fb0700c76f0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.813+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06400ba00 con 0x7fb0700c76f0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.813+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0700d10e0 con 0x7fb0700c76f0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.814+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0700ce280 con 0x7fb0700c76f0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.814+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb06400bba0 con 0x7fb0700c76f0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.815+0000 7fb06e7fc640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb05c0762d0 0x7fb05c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.815+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb064097a20 con 0x7fb0700c76f0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.815+0000 7fb075e8c640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb05c0762d0 0x7fb05c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:36.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.816+0000 7fb075e8c640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb05c0762d0 0x7fb05c0787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f60 tx=0x7fb068007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:36.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:36.820+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0640612f0 con 0x7fb0700c76f0 2024-05-09T01:41:37.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.007+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb070152330 con 0x7fb05c0762d0 2024-05-09T01:41:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.014+0000 7fb06e7fc640 1 -- 172.21.15.42:0/2975533622 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251963 (secure 0 0 0) 0x7fb068005c80 con 0x7fb05c0762d0 2024-05-09T01:41:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb05c0762d0 msgr2=0x7fb05c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb05c0762d0 0x7fb05c0787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f60 tx=0x7fb068007ca0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 msgr2=0x7fb0701527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 0x7fb0701527f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb06400d620 tx=0x7fb06400dae0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 shutdown_connections 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb05c0762d0 0x7fb05c0787e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb070165660 0x7fb07014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0700c76f0 0x7fb0701527f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 --2- 172.21.15.42:0/2975533622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0700b4e00 0x7fb0700d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 >> 172.21.15.42:0/2975533622 conn(0x7fb070068de0 msgr2=0x7fb0700cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 shutdown_connections 2024-05-09T01:41:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.017+0000 7fb0780f0640 1 -- 172.21.15.42:0/2975533622 wait complete. 2024-05-09T01:41:37.026 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-09T01:41:36.221331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":305,"num_write_kb":1690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239976,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734744,"statfs":{"total":773094113280,"available":772848377856,"internally_reserved":0,"allocated":3121152,"data_stored":1784444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396949+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:41:01.396949+0000","last_peered":"2024-05-09T01:41:01.396949+0000","last_clean":"2024-05-09T01:41:01.396949+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:41:01.396949+0000","last_undegraded":"2024-05-09T01:41:01.396949+0000","last_fullsized":"2024-05-09T01:41:01.396949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397106+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:41:01.397106+0000","last_peered":"2024-05-09T01:41:01.397106+0000","last_clean":"2024-05-09T01:41:01.397106+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:41:01.397106+0000","last_undegraded":"2024-05-09T01:41:01.397106+0000","last_fullsized":"2024-05-09T01:41:01.397106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397038+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:41:01.397038+0000","last_peered":"2024-05-09T01:41:01.397038+0000","last_clean":"2024-05-09T01:41:01.397038+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:41:01.397038+0000","last_undegraded":"2024-05-09T01:41:01.397038+0000","last_fullsized":"2024-05-09T01:41:01.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396661+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:41:01.396661+0000","last_peered":"2024-05-09T01:41:01.396661+0000","last_clean":"2024-05-09T01:41:01.396661+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:41:01.396661+0000","last_undegraded":"2024-05-09T01:41:01.396661+0000","last_fullsized":"2024-05-09T01:41:01.396661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397057+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:41:01.397057+0000","last_peered":"2024-05-09T01:41:01.397057+0000","last_clean":"2024-05-09T01:41:01.397057+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:41:01.397057+0000","last_undegraded":"2024-05-09T01:41:01.397057+0000","last_fullsized":"2024-05-09T01:41:01.397057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396811+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:41:01.396811+0000","last_peered":"2024-05-09T01:41:01.396811+0000","last_clean":"2024-05-09T01:41:01.396811+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:41:01.396811+0000","last_undegraded":"2024-05-09T01:41:01.396811+0000","last_fullsized":"2024-05-09T01:41:01.396811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396364+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:41:01.396364+0000","last_peered":"2024-05-09T01:41:01.396364+0000","last_clean":"2024-05-09T01:41:01.396364+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:41:01.396364+0000","last_undegraded":"2024-05-09T01:41:01.396364+0000","last_fullsized":"2024-05-09T01:41:01.396364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:42.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396374+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:41:01.396374+0000","last_peered":"2024-05-09T01:41:01.396374+0000","last_clean":"2024-05-09T01:41:01.396374+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:41:01.396374+0000","last_undegraded":"2024-05-09T01:41:01.396374+0000","last_fullsized":"2024-05-09T01:41:01.396374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.795089+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:09.795089+0000","last_peered":"2024-05-09T01:41:09.795089+0000","last_clean":"2024-05-09T01:41:09.795089+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:09.795089+0000","last_undegraded":"2024-05-09T01:41:09.795089+0000","last_fullsized":"2024-05-09T01:41:09.795089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397053+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:41:01.397053+0000","last_peered":"2024-05-09T01:41:01.397053+0000","last_clean":"2024-05-09T01:41:01.397053+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:41:01.397053+0000","last_undegraded":"2024-05-09T01:41:01.397053+0000","last_fullsized":"2024-05-09T01:41:01.397053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845604+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:20.845604+0000","last_peered":"2024-05-09T01:41:20.845604+0000","last_clean":"2024-05-09T01:41:20.845604+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:20.845604+0000","last_undegraded":"2024-05-09T01:41:20.845604+0000","last_fullsized":"2024-05-09T01:41:20.845604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878417+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:14.878417+0000","last_peered":"2024-05-09T01:41:14.878417+0000","last_clean":"2024-05-09T01:41:14.878417+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:14.878417+0000","last_undegraded":"2024-05-09T01:41:14.878417+0000","last_fullsized":"2024-05-09T01:41:14.878417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842006+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:20.842006+0000","last_peered":"2024-05-09T01:41:20.842006+0000","last_clean":"2024-05-09T01:41:20.842006+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:20.842006+0000","last_undegraded":"2024-05-09T01:41:20.842006+0000","last_fullsized":"2024-05-09T01:41:20.842006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.802976+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:09.802976+0000","last_peered":"2024-05-09T01:41:09.802976+0000","last_clean":"2024-05-09T01:41:09.802976+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:09.802976+0000","last_undegraded":"2024-05-09T01:41:09.802976+0000","last_fullsized":"2024-05-09T01:41:09.802976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.292946+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:26.292946+0000","last_peered":"2024-05-09T01:41:26.292946+0000","last_clean":"2024-05-09T01:41:26.292946+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:26.292946+0000","last_undegraded":"2024-05-09T01:41:26.292946+0000","last_fullsized":"2024-05-09T01:41:26.292946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396844+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:41:01.396844+0000","last_peered":"2024-05-09T01:41:01.396844+0000","last_clean":"2024-05-09T01:41:01.396844+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:41:01.396844+0000","last_undegraded":"2024-05-09T01:41:01.396844+0000","last_fullsized":"2024-05-09T01:41:01.396844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.807472+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:09.807472+0000","last_peered":"2024-05-09T01:41:09.807472+0000","last_clean":"2024-05-09T01:41:09.807472+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:09.807472+0000","last_undegraded":"2024-05-09T01:41:09.807472+0000","last_fullsized":"2024-05-09T01:41:09.807472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397303+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:41:01.397303+0000","last_peered":"2024-05-09T01:41:01.397303+0000","last_clean":"2024-05-09T01:41:01.397303+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:41:01.397303+0000","last_undegraded":"2024-05-09T01:41:01.397303+0000","last_fullsized":"2024-05-09T01:41:01.397303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.290685+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:26.290685+0000","last_peered":"2024-05-09T01:41:26.290685+0000","last_clean":"2024-05-09T01:41:26.290685+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:26.290685+0000","last_undegraded":"2024-05-09T01:41:26.290685+0000","last_fullsized":"2024-05-09T01:41:26.290685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.290534+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:26.290534+0000","last_peered":"2024-05-09T01:41:26.290534+0000","last_clean":"2024-05-09T01:41:26.290534+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:26.290534+0000","last_undegraded":"2024-05-09T01:41:26.290534+0000","last_fullsized":"2024-05-09T01:41:26.290534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397056+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:41:01.397056+0000","last_peered":"2024-05-09T01:41:01.397056+0000","last_clean":"2024-05-09T01:41:01.397056+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:41:01.397056+0000","last_undegraded":"2024-05-09T01:41:01.397056+0000","last_fullsized":"2024-05-09T01:41:01.397056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.844959+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:20.844959+0000","last_peered":"2024-05-09T01:41:20.844959+0000","last_clean":"2024-05-09T01:41:20.844959+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:20.844959+0000","last_undegraded":"2024-05-09T01:41:20.844959+0000","last_fullsized":"2024-05-09T01:41:20.844959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845420+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:20.845420+0000","last_peered":"2024-05-09T01:41:20.845420+0000","last_clean":"2024-05-09T01:41:20.845420+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:20.845420+0000","last_undegraded":"2024-05-09T01:41:20.845420+0000","last_fullsized":"2024-05-09T01:41:20.845420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842360+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:20.842360+0000","last_peered":"2024-05-09T01:41:20.842360+0000","last_clean":"2024-05-09T01:41:20.842360+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:20.842360+0000","last_undegraded":"2024-05-09T01:41:20.842360+0000","last_fullsized":"2024-05-09T01:41:20.842360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744395+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:04.744395+0000","last_peered":"2024-05-09T01:41:04.744395+0000","last_clean":"2024-05-09T01:41:04.744395+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:04.744395+0000","last_undegraded":"2024-05-09T01:41:04.744395+0000","last_fullsized":"2024-05-09T01:41:04.744395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.288505+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:26.288505+0000","last_peered":"2024-05-09T01:41:26.288505+0000","last_clean":"2024-05-09T01:41:26.288505+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:26.288505+0000","last_undegraded":"2024-05-09T01:41:26.288505+0000","last_fullsized":"2024-05-09T01:41:26.288505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845679+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:20.845679+0000","last_peered":"2024-05-09T01:41:20.845679+0000","last_clean":"2024-05-09T01:41:20.845679+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:20.845679+0000","last_undegraded":"2024-05-09T01:41:20.845679+0000","last_fullsized":"2024-05-09T01:41:20.845679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845426+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:20.845426+0000","last_peered":"2024-05-09T01:41:20.845426+0000","last_clean":"2024-05-09T01:41:20.845426+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:20.845426+0000","last_undegraded":"2024-05-09T01:41:20.845426+0000","last_fullsized":"2024-05-09T01:41:20.845426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842048+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:20.842048+0000","last_peered":"2024-05-09T01:41:20.842048+0000","last_clean":"2024-05-09T01:41:20.842048+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:20.842048+0000","last_undegraded":"2024-05-09T01:41:20.842048+0000","last_fullsized":"2024-05-09T01:41:20.842048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878141+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:14.878141+0000","last_peered":"2024-05-09T01:41:14.878141+0000","last_clean":"2024-05-09T01:41:14.878141+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:14.878141+0000","last_undegraded":"2024-05-09T01:41:14.878141+0000","last_fullsized":"2024-05-09T01:41:14.878141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396340+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:41:01.396340+0000","last_peered":"2024-05-09T01:41:01.396340+0000","last_clean":"2024-05-09T01:41:01.396340+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:41:01.396340+0000","last_undegraded":"2024-05-09T01:41:01.396340+0000","last_fullsized":"2024-05-09T01:41:01.396340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878357+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:41:14.878357+0000","last_peered":"2024-05-09T01:41:14.878357+0000","last_clean":"2024-05-09T01:41:14.878357+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:41:14.878357+0000","last_undegraded":"2024-05-09T01:41:14.878357+0000","last_fullsized":"2024-05-09T01:41:14.878357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.292599+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:26.292599+0000","last_peered":"2024-05-09T01:41:26.292599+0000","last_clean":"2024-05-09T01:41:26.292599+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:26.292599+0000","last_undegraded":"2024-05-09T01:41:26.292599+0000","last_fullsized":"2024-05-09T01:41:26.292599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397342+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:41:01.397342+0000","last_peered":"2024-05-09T01:41:01.397342+0000","last_clean":"2024-05-09T01:41:01.397342+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:41:01.397342+0000","last_undegraded":"2024-05-09T01:41:01.397342+0000","last_fullsized":"2024-05-09T01:41:01.397342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.225830+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:01.225830+0000","last_peered":"2024-05-09T01:41:01.225830+0000","last_clean":"2024-05-09T01:41:01.225830+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:01.225830+0000","last_undegraded":"2024-05-09T01:41:01.225830+0000","last_fullsized":"2024-05-09T01:41:01.225830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842733+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:20.842733+0000","last_peered":"2024-05-09T01:41:20.842733+0000","last_clean":"2024-05-09T01:41:20.842733+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:20.842733+0000","last_undegraded":"2024-05-09T01:41:20.842733+0000","last_fullsized":"2024-05-09T01:41:20.842733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845580+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:20.845580+0000","last_peered":"2024-05-09T01:41:20.845580+0000","last_clean":"2024-05-09T01:41:20.845580+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:20.845580+0000","last_undegraded":"2024-05-09T01:41:20.845580+0000","last_fullsized":"2024-05-09T01:41:20.845580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293245+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:26.293245+0000","last_peered":"2024-05-09T01:41:26.293245+0000","last_clean":"2024-05-09T01:41:26.293245+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:26.293245+0000","last_undegraded":"2024-05-09T01:41:26.293245+0000","last_fullsized":"2024-05-09T01:41:26.293245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397004+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:41:01.397004+0000","last_peered":"2024-05-09T01:41:01.397004+0000","last_clean":"2024-05-09T01:41:01.397004+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:41:01.397004+0000","last_undegraded":"2024-05-09T01:41:01.397004+0000","last_fullsized":"2024-05-09T01:41:01.397004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.792876+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:09.792876+0000","last_peered":"2024-05-09T01:41:09.792876+0000","last_clean":"2024-05-09T01:41:09.792876+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:09.792876+0000","last_undegraded":"2024-05-09T01:41:09.792876+0000","last_fullsized":"2024-05-09T01:41:09.792876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396902+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:41:01.396902+0000","last_peered":"2024-05-09T01:41:01.396902+0000","last_clean":"2024-05-09T01:41:01.396902+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:41:01.396902+0000","last_undegraded":"2024-05-09T01:41:01.396902+0000","last_fullsized":"2024-05-09T01:41:01.396902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293405+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:26.293405+0000","last_peered":"2024-05-09T01:41:26.293405+0000","last_clean":"2024-05-09T01:41:26.293405+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:26.293405+0000","last_undegraded":"2024-05-09T01:41:26.293405+0000","last_fullsized":"2024-05-09T01:41:26.293405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842318+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:20.842318+0000","last_peered":"2024-05-09T01:41:20.842318+0000","last_clean":"2024-05-09T01:41:20.842318+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:20.842318+0000","last_undegraded":"2024-05-09T01:41:20.842318+0000","last_fullsized":"2024-05-09T01:41:20.842318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.788381+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:09.788381+0000","last_peered":"2024-05-09T01:41:09.788381+0000","last_clean":"2024-05-09T01:41:09.788381+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:09.788381+0000","last_undegraded":"2024-05-09T01:41:09.788381+0000","last_fullsized":"2024-05-09T01:41:09.788381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293030+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:26.293030+0000","last_peered":"2024-05-09T01:41:26.293030+0000","last_clean":"2024-05-09T01:41:26.293030+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:26.293030+0000","last_undegraded":"2024-05-09T01:41:26.293030+0000","last_fullsized":"2024-05-09T01:41:26.293030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'11","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293334+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:26.293334+0000","last_peered":"2024-05-09T01:41:26.293334+0000","last_clean":"2024-05-09T01:41:26.293334+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:26.293334+0000","last_undegraded":"2024-05-09T01:41:26.293334+0000","last_fullsized":"2024-05-09T01:41:26.293334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396649+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:41:01.396649+0000","last_peered":"2024-05-09T01:41:01.396649+0000","last_clean":"2024-05-09T01:41:01.396649+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:41:01.396649+0000","last_undegraded":"2024-05-09T01:41:01.396649+0000","last_fullsized":"2024-05-09T01:41:01.396649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744707+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:04.744707+0000","last_peered":"2024-05-09T01:41:04.744707+0000","last_clean":"2024-05-09T01:41:04.744707+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:04.744707+0000","last_undegraded":"2024-05-09T01:41:04.744707+0000","last_fullsized":"2024-05-09T01:41:04.744707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.295648+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:41:26.295648+0000","last_peered":"2024-05-09T01:41:26.295648+0000","last_clean":"2024-05-09T01:41:26.295648+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:41:26.295648+0000","last_undegraded":"2024-05-09T01:41:26.295648+0000","last_fullsized":"2024-05-09T01:41:26.295648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":665923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":75857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":77387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":75891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":241664,"data_stored":74917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":74987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":831488,"data_stored":664697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":74785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:37.030 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T01:41:37.030 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:41:37.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.184+0000 7f1dadca8640 1 Processor -- start 2024-05-09T01:41:37.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.184+0000 7f1dadca8640 1 -- start start 2024-05-09T01:41:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1dadca8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1da8073a50 0x7f1da8155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1dadca8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1da80c8400 0x7f1da80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1dadca8640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da8074130 con 0x7f1da8071640 2024-05-09T01:41:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1dadca8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f1da815e400 con 0x7f1da80c8400 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1dadca8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1da80743f0 con 0x7f1da8073a50 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1da6ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1da80c8400 0x7f1da80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1da6ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1da80c8400 0x7f1da80c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60300/0 (socket says 172.21.15.42:60300) 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1da6ffd640 1 -- 172.21.15.42:0/1843349652 learned_addr learned my addr 172.21.15.42:0/1843349652 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1da7fff640 1 --1- 172.21.15.42:0/1843349652 >> v1:172.21.15.42:6789/0 conn(0x7f1da8071640 0x7f1da815e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33018/0 (socket says 172.21.15.42:33018) 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.185+0000 7f1da77fe640 1 --2- 172.21.15.42:0/1843349652 >> v2:172.21.15.181:3300/0 conn(0x7f1da8073a50 0x7f1da8155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.186+0000 7f1da6ffd640 1 -- 172.21.15.42:0/1843349652 >> v2:172.21.15.181:3300/0 conn(0x7f1da8073a50 msgr2=0x7f1da8155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.186+0000 7f1da6ffd640 1 --2- 172.21.15.42:0/1843349652 >> v2:172.21.15.181:3300/0 conn(0x7f1da8073a50 0x7f1da8155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.186+0000 7f1da6ffd640 1 -- 172.21.15.42:0/1843349652 >> v1:172.21.15.42:6789/0 conn(0x7f1da8071640 legacy=0x7f1da815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.186+0000 7f1da6ffd640 1 -- 172.21.15.42:0/1843349652 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da80746d0 con 0x7f1da80c8400 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.186+0000 7f1da6ffd640 1 --2- 172.21.15.42:0/1843349652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da80c8400 0x7f1da80c8810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1da815e580 tx=0x7f1d9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ffe89b0603f8c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1da67fc640 1 -- 172.21.15.42:0/1843349652 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c037070 con 0x7f1da80c8400 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1da67fc640 1 -- 172.21.15.42:0/1843349652 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c032440 con 0x7f1da80c8400 2024-05-09T01:41:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1da67fc640 1 -- 172.21.15.42:0/1843349652 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c032810 con 0x7f1da80c8400 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 -- 172.21.15.42:0/1843349652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da80c8400 msgr2=0x7f1da80c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 --2- 172.21.15.42:0/1843349652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da80c8400 0x7f1da80c8810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1da815e580 tx=0x7f1d9c02a270 comp rx=0 tx=0).stop 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 -- 172.21.15.42:0/1843349652 shutdown_connections 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 --2- 172.21.15.42:0/1843349652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da80c8400 0x7f1da80c8810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 --2- 172.21.15.42:0/1843349652 >> v2:172.21.15.181:3300/0 conn(0x7f1da8073a50 0x7f1da8155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 -- 172.21.15.42:0/1843349652 >> 172.21.15.42:0/1843349652 conn(0x7f1da80cb850 msgr2=0x7f1da80cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 -- 172.21.15.42:0/1843349652 shutdown_connections 2024-05-09T01:41:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.187+0000 7f1dadca8640 1 -- 172.21.15.42:0/1843349652 wait complete. 2024-05-09T01:41:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.189+0000 7f1dadca8640 1 Processor -- start 2024-05-09T01:41:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.189+0000 7f1dadca8640 1 -- start start 2024-05-09T01:41:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.190+0000 7f1dadca8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1da8071640 0x7f1da8152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.190+0000 7f1dadca8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 0x7f1da8151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.190+0000 7f1dadca8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da80c8400 0x7f1da81454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.190+0000 7f1dadca8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1da815efa0 con 0x7f1da8073a50 2024-05-09T01:41:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.190+0000 7f1dadca8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8074c90 con 0x7f1da80c8400 2024-05-09T01:41:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.190+0000 7f1dadca8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1da815f120 con 0x7f1da8071640 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 0x7f1da8151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 0x7f1da8151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60308/0 (socket says 172.21.15.42:60308) 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 -- 172.21.15.42:0/871671853 learned_addr learned my addr 172.21.15.42:0/871671853 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da7fff640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da80c8400 0x7f1da81454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da77fe640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1da8071640 0x7f1da8152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 -- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1da8071640 msgr2=0x7f1da8152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1da8071640 0x7f1da8152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 -- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da80c8400 msgr2=0x7f1da81454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da80c8400 0x7f1da81454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 -- 172.21.15.42:0/871671853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da81522b0 con 0x7f1da8073a50 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da77fe640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1da8071640 0x7f1da8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1da6ffd640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 0x7f1da8151d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c02a2b0 tx=0x7f1d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c041020 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0306c0 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c037040 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da81599e0 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.191+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da815b6c0 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.192+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da8158700 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.193+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d9c044020 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.193+0000 7f1d8ffff640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1d940762d0 0x7f1d940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.194+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1d9c0b7df0 con 0x7f1da8073a50 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.194+0000 7f1da77fe640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1d940762d0 0x7f1d940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.194+0000 7f1da77fe640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1d940762d0 0x7f1d940787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d98006fd0 tx=0x7f1d98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.198+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1d9c04b030 con 0x7f1da8073a50 2024-05-09T01:41:37.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.385+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1da8159770 con 0x7f1d940762d0 2024-05-09T01:41:37.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.392+0000 7f1d8ffff640 1 -- 172.21.15.42:0/871671853 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251963 (secure 0 0 0) 0x7f1da8159770 con 0x7f1d940762d0 2024-05-09T01:41:37.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:37.394 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1d940762d0 msgr2=0x7f1d940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1d940762d0 0x7f1d940787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d98006fd0 tx=0x7f1d98008040 comp rx=0 tx=0).stop 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 msgr2=0x7f1da8151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 0x7f1da8151d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c02a2b0 tx=0x7f1d9c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 shutdown_connections 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1d940762d0 0x7f1d940787e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da80c8400 0x7f1da81454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1da8073a50 0x7f1da8151d70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 --2- 172.21.15.42:0/871671853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1da8071640 0x7f1da8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 >> 172.21.15.42:0/871671853 conn(0x7f1da80cb850 msgr2=0x7f1da8147920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 shutdown_connections 2024-05-09T01:41:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.395+0000 7f1dadca8640 1 -- 172.21.15.42:0/871671853 wait complete. 2024-05-09T01:41:37.404 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-09T01:41:36.221331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":305,"num_write_kb":1690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239976,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734744,"statfs":{"total":773094113280,"available":772848377856,"internally_reserved":0,"allocated":3121152,"data_stored":1784444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743385+0000","last_change":"2024-05-09T01:40:59.761319+0000","last_active":"2024-05-09T01:41:00.743385+0000","last_peered":"2024-05-09T01:41:00.743385+0000","last_clean":"2024-05-09T01:41:00.743385+0000","last_became_active":"2024-05-09T01:40:59.760938+0000","last_became_peered":"2024-05-09T01:40:59.760938+0000","last_unstale":"2024-05-09T01:41:00.743385+0000","last_undegraded":"2024-05-09T01:41:00.743385+0000","last_fullsized":"2024-05-09T01:41:00.743385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:34.656610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895660+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:41:00.895660+0000","last_peered":"2024-05-09T01:41:00.895660+0000","last_clean":"2024-05-09T01:41:00.895660+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:41:00.895660+0000","last_undegraded":"2024-05-09T01:41:00.895660+0000","last_fullsized":"2024-05-09T01:41:00.895660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396949+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:41:01.396949+0000","last_peered":"2024-05-09T01:41:01.396949+0000","last_clean":"2024-05-09T01:41:01.396949+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:41:01.396949+0000","last_undegraded":"2024-05-09T01:41:01.396949+0000","last_fullsized":"2024-05-09T01:41:01.396949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396890+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:41:01.396890+0000","last_peered":"2024-05-09T01:41:01.396890+0000","last_clean":"2024-05-09T01:41:01.396890+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:41:01.396890+0000","last_undegraded":"2024-05-09T01:41:01.396890+0000","last_fullsized":"2024-05-09T01:41:01.396890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742890+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:41:00.742890+0000","last_peered":"2024-05-09T01:41:00.742890+0000","last_clean":"2024-05-09T01:41:00.742890+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:41:00.742890+0000","last_undegraded":"2024-05-09T01:41:00.742890+0000","last_fullsized":"2024-05-09T01:41:00.742890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396718+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:41:01.396718+0000","last_peered":"2024-05-09T01:41:01.396718+0000","last_clean":"2024-05-09T01:41:01.396718+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:41:01.396718+0000","last_undegraded":"2024-05-09T01:41:01.396718+0000","last_fullsized":"2024-05-09T01:41:01.396718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742752+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:41:00.742752+0000","last_peered":"2024-05-09T01:41:00.742752+0000","last_clean":"2024-05-09T01:41:00.742752+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:41:00.742752+0000","last_undegraded":"2024-05-09T01:41:00.742752+0000","last_fullsized":"2024-05-09T01:41:00.742752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.737952+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:41:00.737952+0000","last_peered":"2024-05-09T01:41:00.737952+0000","last_clean":"2024-05-09T01:41:00.737952+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:41:00.737952+0000","last_undegraded":"2024-05-09T01:41:00.737952+0000","last_fullsized":"2024-05-09T01:41:00.737952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743496+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:41:00.743496+0000","last_peered":"2024-05-09T01:41:00.743496+0000","last_clean":"2024-05-09T01:41:00.743496+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:41:00.743496+0000","last_undegraded":"2024-05-09T01:41:00.743496+0000","last_fullsized":"2024-05-09T01:41:00.743496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337613+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:41:01.337613+0000","last_peered":"2024-05-09T01:41:01.337613+0000","last_clean":"2024-05-09T01:41:01.337613+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:41:01.337613+0000","last_undegraded":"2024-05-09T01:41:01.337613+0000","last_fullsized":"2024-05-09T01:41:01.337613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337464+0000","last_change":"2024-05-09T01:40:59.753761+0000","last_active":"2024-05-09T01:41:01.337464+0000","last_peered":"2024-05-09T01:41:01.337464+0000","last_clean":"2024-05-09T01:41:01.337464+0000","last_became_active":"2024-05-09T01:40:59.753291+0000","last_became_peered":"2024-05-09T01:40:59.753291+0000","last_unstale":"2024-05-09T01:41:01.337464+0000","last_undegraded":"2024-05-09T01:41:01.337464+0000","last_fullsized":"2024-05-09T01:41:01.337464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:51.828554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397106+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:41:01.397106+0000","last_peered":"2024-05-09T01:41:01.397106+0000","last_clean":"2024-05-09T01:41:01.397106+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:41:01.397106+0000","last_undegraded":"2024-05-09T01:41:01.397106+0000","last_fullsized":"2024-05-09T01:41:01.397106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738291+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:41:00.738291+0000","last_peered":"2024-05-09T01:41:00.738291+0000","last_clean":"2024-05-09T01:41:00.738291+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:41:00.738291+0000","last_undegraded":"2024-05-09T01:41:00.738291+0000","last_fullsized":"2024-05-09T01:41:00.738291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397038+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:41:01.397038+0000","last_peered":"2024-05-09T01:41:01.397038+0000","last_clean":"2024-05-09T01:41:01.397038+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:41:01.397038+0000","last_undegraded":"2024-05-09T01:41:01.397038+0000","last_fullsized":"2024-05-09T01:41:01.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895381+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:41:00.895381+0000","last_peered":"2024-05-09T01:41:00.895381+0000","last_clean":"2024-05-09T01:41:00.895381+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:41:00.895381+0000","last_undegraded":"2024-05-09T01:41:00.895381+0000","last_fullsized":"2024-05-09T01:41:00.895381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396414+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:41:01.396414+0000","last_peered":"2024-05-09T01:41:01.396414+0000","last_clean":"2024-05-09T01:41:01.396414+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:41:01.396414+0000","last_undegraded":"2024-05-09T01:41:01.396414+0000","last_fullsized":"2024-05-09T01:41:01.396414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397135+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:41:01.397135+0000","last_peered":"2024-05-09T01:41:01.397135+0000","last_clean":"2024-05-09T01:41:01.397135+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:41:01.397135+0000","last_undegraded":"2024-05-09T01:41:01.397135+0000","last_fullsized":"2024-05-09T01:41:01.397135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396661+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:41:01.396661+0000","last_peered":"2024-05-09T01:41:01.396661+0000","last_clean":"2024-05-09T01:41:01.396661+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:41:01.396661+0000","last_undegraded":"2024-05-09T01:41:01.396661+0000","last_fullsized":"2024-05-09T01:41:01.396661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743351+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:41:00.743351+0000","last_peered":"2024-05-09T01:41:00.743351+0000","last_clean":"2024-05-09T01:41:00.743351+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:41:00.743351+0000","last_undegraded":"2024-05-09T01:41:00.743351+0000","last_fullsized":"2024-05-09T01:41:00.743351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337455+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:41:01.337455+0000","last_peered":"2024-05-09T01:41:01.337455+0000","last_clean":"2024-05-09T01:41:01.337455+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:41:01.337455+0000","last_undegraded":"2024-05-09T01:41:01.337455+0000","last_fullsized":"2024-05-09T01:41:01.337455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397057+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:41:01.397057+0000","last_peered":"2024-05-09T01:41:01.397057+0000","last_clean":"2024-05-09T01:41:01.397057+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:41:01.397057+0000","last_undegraded":"2024-05-09T01:41:01.397057+0000","last_fullsized":"2024-05-09T01:41:01.397057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397222+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:41:01.397222+0000","last_peered":"2024-05-09T01:41:01.397222+0000","last_clean":"2024-05-09T01:41:01.397222+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:41:01.397222+0000","last_undegraded":"2024-05-09T01:41:01.397222+0000","last_fullsized":"2024-05-09T01:41:01.397222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738008+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:41:00.738008+0000","last_peered":"2024-05-09T01:41:00.738008+0000","last_clean":"2024-05-09T01:41:00.738008+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:41:00.738008+0000","last_undegraded":"2024-05-09T01:41:00.738008+0000","last_fullsized":"2024-05-09T01:41:00.738008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396572+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:41:01.396572+0000","last_peered":"2024-05-09T01:41:01.396572+0000","last_clean":"2024-05-09T01:41:01.396572+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:41:01.396572+0000","last_undegraded":"2024-05-09T01:41:01.396572+0000","last_fullsized":"2024-05-09T01:41:01.396572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738537+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:41:00.738537+0000","last_peered":"2024-05-09T01:41:00.738537+0000","last_clean":"2024-05-09T01:41:00.738537+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:41:00.738537+0000","last_undegraded":"2024-05-09T01:41:00.738537+0000","last_fullsized":"2024-05-09T01:41:00.738537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337612+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:41:01.337612+0000","last_peered":"2024-05-09T01:41:01.337612+0000","last_clean":"2024-05-09T01:41:01.337612+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:41:01.337612+0000","last_undegraded":"2024-05-09T01:41:01.337612+0000","last_fullsized":"2024-05-09T01:41:01.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895524+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:41:00.895524+0000","last_peered":"2024-05-09T01:41:00.895524+0000","last_clean":"2024-05-09T01:41:00.895524+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:41:00.895524+0000","last_undegraded":"2024-05-09T01:41:00.895524+0000","last_fullsized":"2024-05-09T01:41:00.895524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738534+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:41:00.738534+0000","last_peered":"2024-05-09T01:41:00.738534+0000","last_clean":"2024-05-09T01:41:00.738534+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:41:00.738534+0000","last_undegraded":"2024-05-09T01:41:00.738534+0000","last_fullsized":"2024-05-09T01:41:00.738534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396811+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:41:01.396811+0000","last_peered":"2024-05-09T01:41:01.396811+0000","last_clean":"2024-05-09T01:41:01.396811+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:41:01.396811+0000","last_undegraded":"2024-05-09T01:41:01.396811+0000","last_fullsized":"2024-05-09T01:41:01.396811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397428+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:41:01.397428+0000","last_peered":"2024-05-09T01:41:01.397428+0000","last_clean":"2024-05-09T01:41:01.397428+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:41:01.397428+0000","last_undegraded":"2024-05-09T01:41:01.397428+0000","last_fullsized":"2024-05-09T01:41:01.397428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396364+0000","last_change":"2024-05-09T01:40:59.758230+0000","last_active":"2024-05-09T01:41:01.396364+0000","last_peered":"2024-05-09T01:41:01.396364+0000","last_clean":"2024-05-09T01:41:01.396364+0000","last_became_active":"2024-05-09T01:40:59.757382+0000","last_became_peered":"2024-05-09T01:40:59.757382+0000","last_unstale":"2024-05-09T01:41:01.396364+0000","last_undegraded":"2024-05-09T01:41:01.396364+0000","last_fullsized":"2024-05-09T01:41:01.396364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:42.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337230+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:41:01.337230+0000","last_peered":"2024-05-09T01:41:01.337230+0000","last_clean":"2024-05-09T01:41:01.337230+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:41:01.337230+0000","last_undegraded":"2024-05-09T01:41:01.337230+0000","last_fullsized":"2024-05-09T01:41:01.337230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396374+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:41:01.396374+0000","last_peered":"2024-05-09T01:41:01.396374+0000","last_clean":"2024-05-09T01:41:01.396374+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:41:01.396374+0000","last_undegraded":"2024-05-09T01:41:01.396374+0000","last_fullsized":"2024-05-09T01:41:01.396374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.795089+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:09.795089+0000","last_peered":"2024-05-09T01:41:09.795089+0000","last_clean":"2024-05-09T01:41:09.795089+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:09.795089+0000","last_undegraded":"2024-05-09T01:41:09.795089+0000","last_fullsized":"2024-05-09T01:41:09.795089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397053+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:41:01.397053+0000","last_peered":"2024-05-09T01:41:01.397053+0000","last_clean":"2024-05-09T01:41:01.397053+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:41:01.397053+0000","last_undegraded":"2024-05-09T01:41:01.397053+0000","last_fullsized":"2024-05-09T01:41:01.397053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845604+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:20.845604+0000","last_peered":"2024-05-09T01:41:20.845604+0000","last_clean":"2024-05-09T01:41:20.845604+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:20.845604+0000","last_undegraded":"2024-05-09T01:41:20.845604+0000","last_fullsized":"2024-05-09T01:41:20.845604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878417+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:14.878417+0000","last_peered":"2024-05-09T01:41:14.878417+0000","last_clean":"2024-05-09T01:41:14.878417+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:14.878417+0000","last_undegraded":"2024-05-09T01:41:14.878417+0000","last_fullsized":"2024-05-09T01:41:14.878417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738019+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:41:00.738019+0000","last_peered":"2024-05-09T01:41:00.738019+0000","last_clean":"2024-05-09T01:41:00.738019+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:41:00.738019+0000","last_undegraded":"2024-05-09T01:41:00.738019+0000","last_fullsized":"2024-05-09T01:41:00.738019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842006+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:20.842006+0000","last_peered":"2024-05-09T01:41:20.842006+0000","last_clean":"2024-05-09T01:41:20.842006+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:20.842006+0000","last_undegraded":"2024-05-09T01:41:20.842006+0000","last_fullsized":"2024-05-09T01:41:20.842006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895367+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:41:00.895367+0000","last_peered":"2024-05-09T01:41:00.895367+0000","last_clean":"2024-05-09T01:41:00.895367+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:41:00.895367+0000","last_undegraded":"2024-05-09T01:41:00.895367+0000","last_fullsized":"2024-05-09T01:41:00.895367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.802976+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:41:09.802976+0000","last_peered":"2024-05-09T01:41:09.802976+0000","last_clean":"2024-05-09T01:41:09.802976+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:41:09.802976+0000","last_undegraded":"2024-05-09T01:41:09.802976+0000","last_fullsized":"2024-05-09T01:41:09.802976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396980+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:41:01.396980+0000","last_peered":"2024-05-09T01:41:01.396980+0000","last_clean":"2024-05-09T01:41:01.396980+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:41:01.396980+0000","last_undegraded":"2024-05-09T01:41:01.396980+0000","last_fullsized":"2024-05-09T01:41:01.396980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.292946+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:26.292946+0000","last_peered":"2024-05-09T01:41:26.292946+0000","last_clean":"2024-05-09T01:41:26.292946+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:26.292946+0000","last_undegraded":"2024-05-09T01:41:26.292946+0000","last_fullsized":"2024-05-09T01:41:26.292946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396844+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:41:01.396844+0000","last_peered":"2024-05-09T01:41:01.396844+0000","last_clean":"2024-05-09T01:41:01.396844+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:41:01.396844+0000","last_undegraded":"2024-05-09T01:41:01.396844+0000","last_fullsized":"2024-05-09T01:41:01.396844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.807472+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:41:09.807472+0000","last_peered":"2024-05-09T01:41:09.807472+0000","last_clean":"2024-05-09T01:41:09.807472+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:41:09.807472+0000","last_undegraded":"2024-05-09T01:41:09.807472+0000","last_fullsized":"2024-05-09T01:41:09.807472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397303+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:41:01.397303+0000","last_peered":"2024-05-09T01:41:01.397303+0000","last_clean":"2024-05-09T01:41:01.397303+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:41:01.397303+0000","last_undegraded":"2024-05-09T01:41:01.397303+0000","last_fullsized":"2024-05-09T01:41:01.397303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.290685+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:41:26.290685+0000","last_peered":"2024-05-09T01:41:26.290685+0000","last_clean":"2024-05-09T01:41:26.290685+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:41:26.290685+0000","last_undegraded":"2024-05-09T01:41:26.290685+0000","last_fullsized":"2024-05-09T01:41:26.290685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743058+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:41:00.743058+0000","last_peered":"2024-05-09T01:41:00.743058+0000","last_clean":"2024-05-09T01:41:00.743058+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:41:00.743058+0000","last_undegraded":"2024-05-09T01:41:00.743058+0000","last_fullsized":"2024-05-09T01:41:00.743058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.290534+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:26.290534+0000","last_peered":"2024-05-09T01:41:26.290534+0000","last_clean":"2024-05-09T01:41:26.290534+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:26.290534+0000","last_undegraded":"2024-05-09T01:41:26.290534+0000","last_fullsized":"2024-05-09T01:41:26.290534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397056+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:41:01.397056+0000","last_peered":"2024-05-09T01:41:01.397056+0000","last_clean":"2024-05-09T01:41:01.397056+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:41:01.397056+0000","last_undegraded":"2024-05-09T01:41:01.397056+0000","last_fullsized":"2024-05-09T01:41:01.397056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.844959+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:20.844959+0000","last_peered":"2024-05-09T01:41:20.844959+0000","last_clean":"2024-05-09T01:41:20.844959+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:20.844959+0000","last_undegraded":"2024-05-09T01:41:20.844959+0000","last_fullsized":"2024-05-09T01:41:20.844959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742984+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:41:00.742984+0000","last_peered":"2024-05-09T01:41:00.742984+0000","last_clean":"2024-05-09T01:41:00.742984+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:41:00.742984+0000","last_undegraded":"2024-05-09T01:41:00.742984+0000","last_fullsized":"2024-05-09T01:41:00.742984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845420+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:20.845420+0000","last_peered":"2024-05-09T01:41:20.845420+0000","last_clean":"2024-05-09T01:41:20.845420+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:20.845420+0000","last_undegraded":"2024-05-09T01:41:20.845420+0000","last_fullsized":"2024-05-09T01:41:20.845420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337381+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:41:01.337381+0000","last_peered":"2024-05-09T01:41:01.337381+0000","last_clean":"2024-05-09T01:41:01.337381+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:41:01.337381+0000","last_undegraded":"2024-05-09T01:41:01.337381+0000","last_fullsized":"2024-05-09T01:41:01.337381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842360+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:20.842360+0000","last_peered":"2024-05-09T01:41:20.842360+0000","last_clean":"2024-05-09T01:41:20.842360+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:20.842360+0000","last_undegraded":"2024-05-09T01:41:20.842360+0000","last_fullsized":"2024-05-09T01:41:20.842360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742807+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:41:00.742807+0000","last_peered":"2024-05-09T01:41:00.742807+0000","last_clean":"2024-05-09T01:41:00.742807+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:41:00.742807+0000","last_undegraded":"2024-05-09T01:41:00.742807+0000","last_fullsized":"2024-05-09T01:41:00.742807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744395+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:04.744395+0000","last_peered":"2024-05-09T01:41:04.744395+0000","last_clean":"2024-05-09T01:41:04.744395+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:04.744395+0000","last_undegraded":"2024-05-09T01:41:04.744395+0000","last_fullsized":"2024-05-09T01:41:04.744395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743214+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:41:00.743214+0000","last_peered":"2024-05-09T01:41:00.743214+0000","last_clean":"2024-05-09T01:41:00.743214+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:41:00.743214+0000","last_undegraded":"2024-05-09T01:41:00.743214+0000","last_fullsized":"2024-05-09T01:41:00.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.288505+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:26.288505+0000","last_peered":"2024-05-09T01:41:26.288505+0000","last_clean":"2024-05-09T01:41:26.288505+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:26.288505+0000","last_undegraded":"2024-05-09T01:41:26.288505+0000","last_fullsized":"2024-05-09T01:41:26.288505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743502+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:41:00.743502+0000","last_peered":"2024-05-09T01:41:00.743502+0000","last_clean":"2024-05-09T01:41:00.743502+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:41:00.743502+0000","last_undegraded":"2024-05-09T01:41:00.743502+0000","last_fullsized":"2024-05-09T01:41:00.743502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845679+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:20.845679+0000","last_peered":"2024-05-09T01:41:20.845679+0000","last_clean":"2024-05-09T01:41:20.845679+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:20.845679+0000","last_undegraded":"2024-05-09T01:41:20.845679+0000","last_fullsized":"2024-05-09T01:41:20.845679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397251+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:41:01.397251+0000","last_peered":"2024-05-09T01:41:01.397251+0000","last_clean":"2024-05-09T01:41:01.397251+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:41:01.397251+0000","last_undegraded":"2024-05-09T01:41:01.397251+0000","last_fullsized":"2024-05-09T01:41:01.397251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845426+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:20.845426+0000","last_peered":"2024-05-09T01:41:20.845426+0000","last_clean":"2024-05-09T01:41:20.845426+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:20.845426+0000","last_undegraded":"2024-05-09T01:41:20.845426+0000","last_fullsized":"2024-05-09T01:41:20.845426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.743190+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:41:00.743190+0000","last_peered":"2024-05-09T01:41:00.743190+0000","last_clean":"2024-05-09T01:41:00.743190+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:41:00.743190+0000","last_undegraded":"2024-05-09T01:41:00.743190+0000","last_fullsized":"2024-05-09T01:41:00.743190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.742823+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:41:00.742823+0000","last_peered":"2024-05-09T01:41:00.742823+0000","last_clean":"2024-05-09T01:41:00.742823+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:41:00.742823+0000","last_undegraded":"2024-05-09T01:41:00.742823+0000","last_fullsized":"2024-05-09T01:41:00.742823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842048+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:41:20.842048+0000","last_peered":"2024-05-09T01:41:20.842048+0000","last_clean":"2024-05-09T01:41:20.842048+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:41:20.842048+0000","last_undegraded":"2024-05-09T01:41:20.842048+0000","last_fullsized":"2024-05-09T01:41:20.842048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738466+0000","last_change":"2024-05-09T01:40:59.756256+0000","last_active":"2024-05-09T01:41:00.738466+0000","last_peered":"2024-05-09T01:41:00.738466+0000","last_clean":"2024-05-09T01:41:00.738466+0000","last_became_active":"2024-05-09T01:40:59.755835+0000","last_became_peered":"2024-05-09T01:40:59.755835+0000","last_unstale":"2024-05-09T01:41:00.738466+0000","last_undegraded":"2024-05-09T01:41:00.738466+0000","last_fullsized":"2024-05-09T01:41:00.738466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:01.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878141+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:41:14.878141+0000","last_peered":"2024-05-09T01:41:14.878141+0000","last_clean":"2024-05-09T01:41:14.878141+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:41:14.878141+0000","last_undegraded":"2024-05-09T01:41:14.878141+0000","last_fullsized":"2024-05-09T01:41:14.878141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396340+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:41:01.396340+0000","last_peered":"2024-05-09T01:41:01.396340+0000","last_clean":"2024-05-09T01:41:01.396340+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:41:01.396340+0000","last_undegraded":"2024-05-09T01:41:01.396340+0000","last_fullsized":"2024-05-09T01:41:01.396340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:14.878357+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:41:14.878357+0000","last_peered":"2024-05-09T01:41:14.878357+0000","last_clean":"2024-05-09T01:41:14.878357+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:41:14.878357+0000","last_undegraded":"2024-05-09T01:41:14.878357+0000","last_fullsized":"2024-05-09T01:41:14.878357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895433+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:41:00.895433+0000","last_peered":"2024-05-09T01:41:00.895433+0000","last_clean":"2024-05-09T01:41:00.895433+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:41:00.895433+0000","last_undegraded":"2024-05-09T01:41:00.895433+0000","last_fullsized":"2024-05-09T01:41:00.895433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.292599+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:41:26.292599+0000","last_peered":"2024-05-09T01:41:26.292599+0000","last_clean":"2024-05-09T01:41:26.292599+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:41:26.292599+0000","last_undegraded":"2024-05-09T01:41:26.292599+0000","last_fullsized":"2024-05-09T01:41:26.292599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397342+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:41:01.397342+0000","last_peered":"2024-05-09T01:41:01.397342+0000","last_clean":"2024-05-09T01:41:01.397342+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:41:01.397342+0000","last_undegraded":"2024-05-09T01:41:01.397342+0000","last_fullsized":"2024-05-09T01:41:01.397342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.225830+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:41:01.225830+0000","last_peered":"2024-05-09T01:41:01.225830+0000","last_clean":"2024-05-09T01:41:01.225830+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:41:01.225830+0000","last_undegraded":"2024-05-09T01:41:01.225830+0000","last_fullsized":"2024-05-09T01:41:01.225830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396907+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:41:01.396907+0000","last_peered":"2024-05-09T01:41:01.396907+0000","last_clean":"2024-05-09T01:41:01.396907+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:41:01.396907+0000","last_undegraded":"2024-05-09T01:41:01.396907+0000","last_fullsized":"2024-05-09T01:41:01.396907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842733+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:41:20.842733+0000","last_peered":"2024-05-09T01:41:20.842733+0000","last_clean":"2024-05-09T01:41:20.842733+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:41:20.842733+0000","last_undegraded":"2024-05-09T01:41:20.842733+0000","last_fullsized":"2024-05-09T01:41:20.842733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.895626+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:41:00.895626+0000","last_peered":"2024-05-09T01:41:00.895626+0000","last_clean":"2024-05-09T01:41:00.895626+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:41:00.895626+0000","last_undegraded":"2024-05-09T01:41:00.895626+0000","last_fullsized":"2024-05-09T01:41:00.895626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.845580+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:41:20.845580+0000","last_peered":"2024-05-09T01:41:20.845580+0000","last_clean":"2024-05-09T01:41:20.845580+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:41:20.845580+0000","last_undegraded":"2024-05-09T01:41:20.845580+0000","last_fullsized":"2024-05-09T01:41:20.845580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738567+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:41:00.738567+0000","last_peered":"2024-05-09T01:41:00.738567+0000","last_clean":"2024-05-09T01:41:00.738567+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:41:00.738567+0000","last_undegraded":"2024-05-09T01:41:00.738567+0000","last_fullsized":"2024-05-09T01:41:00.738567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293245+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:26.293245+0000","last_peered":"2024-05-09T01:41:26.293245+0000","last_clean":"2024-05-09T01:41:26.293245+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:26.293245+0000","last_undegraded":"2024-05-09T01:41:26.293245+0000","last_fullsized":"2024-05-09T01:41:26.293245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397004+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:41:01.397004+0000","last_peered":"2024-05-09T01:41:01.397004+0000","last_clean":"2024-05-09T01:41:01.397004+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:41:01.397004+0000","last_undegraded":"2024-05-09T01:41:01.397004+0000","last_fullsized":"2024-05-09T01:41:01.397004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.792876+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:09.792876+0000","last_peered":"2024-05-09T01:41:09.792876+0000","last_clean":"2024-05-09T01:41:09.792876+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:09.792876+0000","last_undegraded":"2024-05-09T01:41:09.792876+0000","last_fullsized":"2024-05-09T01:41:09.792876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396902+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:41:01.396902+0000","last_peered":"2024-05-09T01:41:01.396902+0000","last_clean":"2024-05-09T01:41:01.396902+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:41:01.396902+0000","last_undegraded":"2024-05-09T01:41:01.396902+0000","last_fullsized":"2024-05-09T01:41:01.396902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293405+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:26.293405+0000","last_peered":"2024-05-09T01:41:26.293405+0000","last_clean":"2024-05-09T01:41:26.293405+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:26.293405+0000","last_undegraded":"2024-05-09T01:41:26.293405+0000","last_fullsized":"2024-05-09T01:41:26.293405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738438+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:41:00.738438+0000","last_peered":"2024-05-09T01:41:00.738438+0000","last_clean":"2024-05-09T01:41:00.738438+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:41:00.738438+0000","last_undegraded":"2024-05-09T01:41:00.738438+0000","last_fullsized":"2024-05-09T01:41:00.738438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:20.842318+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:20.842318+0000","last_peered":"2024-05-09T01:41:20.842318+0000","last_clean":"2024-05-09T01:41:20.842318+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:20.842318+0000","last_undegraded":"2024-05-09T01:41:20.842318+0000","last_fullsized":"2024-05-09T01:41:20.842318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738462+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:41:00.738462+0000","last_peered":"2024-05-09T01:41:00.738462+0000","last_clean":"2024-05-09T01:41:00.738462+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:41:00.738462+0000","last_undegraded":"2024-05-09T01:41:00.738462+0000","last_fullsized":"2024-05-09T01:41:00.738462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:09.788381+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:41:09.788381+0000","last_peered":"2024-05-09T01:41:09.788381+0000","last_clean":"2024-05-09T01:41:09.788381+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:41:09.788381+0000","last_undegraded":"2024-05-09T01:41:09.788381+0000","last_fullsized":"2024-05-09T01:41:09.788381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.337250+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:41:01.337250+0000","last_peered":"2024-05-09T01:41:01.337250+0000","last_clean":"2024-05-09T01:41:01.337250+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:41:01.337250+0000","last_undegraded":"2024-05-09T01:41:01.337250+0000","last_fullsized":"2024-05-09T01:41:01.337250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397072+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:41:01.397072+0000","last_peered":"2024-05-09T01:41:01.397072+0000","last_clean":"2024-05-09T01:41:01.397072+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:41:01.397072+0000","last_undegraded":"2024-05-09T01:41:01.397072+0000","last_fullsized":"2024-05-09T01:41:01.397072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293030+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:26.293030+0000","last_peered":"2024-05-09T01:41:26.293030+0000","last_clean":"2024-05-09T01:41:26.293030+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:26.293030+0000","last_undegraded":"2024-05-09T01:41:26.293030+0000","last_fullsized":"2024-05-09T01:41:26.293030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.397318+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:41:01.397318+0000","last_peered":"2024-05-09T01:41:01.397318+0000","last_clean":"2024-05-09T01:41:01.397318+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:41:01.397318+0000","last_undegraded":"2024-05-09T01:41:01.397318+0000","last_fullsized":"2024-05-09T01:41:01.397318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'11","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.293334+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:41:26.293334+0000","last_peered":"2024-05-09T01:41:26.293334+0000","last_clean":"2024-05-09T01:41:26.293334+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:41:26.293334+0000","last_undegraded":"2024-05-09T01:41:26.293334+0000","last_fullsized":"2024-05-09T01:41:26.293334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:01.396649+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:41:01.396649+0000","last_peered":"2024-05-09T01:41:01.396649+0000","last_clean":"2024-05-09T01:41:01.396649+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:41:01.396649+0000","last_undegraded":"2024-05-09T01:41:01.396649+0000","last_fullsized":"2024-05-09T01:41:01.396649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:04.744707+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:41:04.744707+0000","last_peered":"2024-05-09T01:41:04.744707+0000","last_clean":"2024-05-09T01:41:04.744707+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:41:04.744707+0000","last_undegraded":"2024-05-09T01:41:04.744707+0000","last_fullsized":"2024-05-09T01:41:04.744707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:00.738178+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:41:00.738178+0000","last_peered":"2024-05-09T01:41:00.738178+0000","last_clean":"2024-05-09T01:41:00.738178+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:41:00.738178+0000","last_undegraded":"2024-05-09T01:41:00.738178+0000","last_fullsized":"2024-05-09T01:41:00.738178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T01:41:26.295648+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:41:26.295648+0000","last_peered":"2024-05-09T01:41:26.295648+0000","last_clean":"2024-05-09T01:41:26.295648+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:41:26.295648+0000","last_undegraded":"2024-05-09T01:41:26.295648+0000","last_fullsized":"2024-05-09T01:41:26.295648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":665923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":75857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":77387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":75891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":241664,"data_stored":74917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":74987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":831488,"data_stored":664697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":74785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:41:37.409 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:37.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.561+0000 7fe33fcbd640 1 Processor -- start 2024-05-09T01:41:37.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.561+0000 7fe33fcbd640 1 -- start start 2024-05-09T01:41:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33fcbd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3380ceb00 0x7fe3380cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33fcbd640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3380c7bf0 con 0x7fe3380cdaa0 2024-05-09T01:41:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33fcbd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3380c7ed0 con 0x7fe338157100 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33fcbd640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe3380c79a0 con 0x7fe3380ceb00 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33e25a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3380ceb00 0x7fe3380cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33da59640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe3380cdaa0 0x7fe3380ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33026/0 (socket says 172.21.15.42:33026) 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33da59640 1 -- 172.21.15.42:0/3734473473 learned_addr learned my addr 172.21.15.42:0/3734473473 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33e25a640 1 -- 172.21.15.42:0/3734473473 >> v1:172.21.15.181:6789/0 conn(0x7fe338157100 legacy=0x7fe338160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33e25a640 1 -- 172.21.15.42:0/3734473473 >> v1:172.21.15.42:6789/0 conn(0x7fe3380cdaa0 legacy=0x7fe3380ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.563+0000 7fe33e25a640 1 -- 172.21.15.42:0/3734473473 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3380c81b0 con 0x7fe3380ceb00 2024-05-09T01:41:37.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.564+0000 7fe33e25a640 1 --2- 172.21.15.42:0/3734473473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe3380cef10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3380c7b20 tx=0x7fe33002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5211b497c88956b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.564+0000 7fe33ca57640 1 -- 172.21.15.42:0/3734473473 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330037070 con 0x7fe3380ceb00 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.564+0000 7fe33ca57640 1 -- 172.21.15.42:0/3734473473 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe330032440 con 0x7fe3380ceb00 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.564+0000 7fe33ca57640 1 -- 172.21.15.42:0/3734473473 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330032810 con 0x7fe3380ceb00 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3734473473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 msgr2=0x7fe3380cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3734473473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe3380cef10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3380c7b20 tx=0x7fe33002a210 comp rx=0 tx=0).stop 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3734473473 shutdown_connections 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3734473473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe3380cef10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3734473473 >> 172.21.15.42:0/3734473473 conn(0x7fe338068610 msgr2=0x7fe338068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3734473473 shutdown_connections 2024-05-09T01:41:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.565+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3734473473 wait complete. 2024-05-09T01:41:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.567+0000 7fe33fcbd640 1 Processor -- start 2024-05-09T01:41:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.567+0000 7fe33fcbd640 1 -- start start 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33fcbd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3380cdaa0 0x7fe33815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33fcbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe33815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33fcbd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe338157100 0x7fe338151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33fcbd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe338160470 con 0x7fe3380ceb00 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33fcbd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe3380c8770 con 0x7fe3380cdaa0 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33fcbd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe3380ce7e0 con 0x7fe338157100 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe33815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe33815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60322/0 (socket says 172.21.15.42:60322) 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 -- 172.21.15.42:0/3281685205 learned_addr learned my addr 172.21.15.42:0/3281685205 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33da59640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3380cdaa0 0x7fe33815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33e25a640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe338157100 0x7fe338151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 -- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe338157100 msgr2=0x7fe338151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe338157100 0x7fe338151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 -- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3380cdaa0 msgr2=0x7fe33815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3380cdaa0 0x7fe33815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.568+0000 7fe33d258640 1 -- 172.21.15.42:0/3281685205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33815fa40 con 0x7fe3380ceb00 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.569+0000 7fe33d258640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe33815f1d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00c370 tx=0x7fe32c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.569+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c017070 con 0x7fe3380ceb00 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.569+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32c0052d0 con 0x7fe3380ceb00 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.569+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33815fce0 con 0x7fe3380ceb00 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.569+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c003830 con 0x7fe3380ceb00 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.569+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33815c7e0 con 0x7fe3380ceb00 2024-05-09T01:41:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.570+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33815b9c0 con 0x7fe3380ceb00 2024-05-09T01:41:37.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.570+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe32c01a070 con 0x7fe3380ceb00 2024-05-09T01:41:37.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.571+0000 7fe3367fc640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe324076300 0x7fe324078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.571+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe32c096800 con 0x7fe3380ceb00 2024-05-09T01:41:37.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.571+0000 7fe33da59640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe324076300 0x7fe324078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.572+0000 7fe33da59640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe324076300 0x7fe324078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3280012e0 tx=0x7fe328009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.576+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe32c05fb00 con 0x7fe3380ceb00 2024-05-09T01:41:37.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.804+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3380c74e0 con 0x7fe3380ceb00 2024-05-09T01:41:37.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.804+0000 7fe3367fc640 1 -- 172.21.15.42:0/3281685205 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7fe32c068140 con 0x7fe3380ceb00 2024-05-09T01:41:37.802 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:37.802 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:41:37.802 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:41:37.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe324076300 msgr2=0x7fe324078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe324076300 0x7fe324078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3280012e0 tx=0x7fe328009040 comp rx=0 tx=0).stop 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 msgr2=0x7fe33815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe33815f1d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00c370 tx=0x7fe32c00c830 comp rx=0 tx=0).stop 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 shutdown_connections 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe324076300 0x7fe324078810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe338157100 0x7fe338151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3380ceb00 0x7fe33815f1d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 --2- 172.21.15.42:0/3281685205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3380cdaa0 0x7fe33815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 >> 172.21.15.42:0/3281685205 conn(0x7fe338068610 msgr2=0x7fe338155150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 shutdown_connections 2024-05-09T01:41:37.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.807+0000 7fe33fcbd640 1 -- 172.21.15.42:0/3281685205 wait complete. 2024-05-09T01:41:37.816 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:37.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.933+0000 7f45bead1640 1 Processor -- start 2024-05-09T01:41:37.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.933+0000 7f45bead1640 1 -- start start 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.934+0000 7f45bead1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45b80cdaa0 0x7f45b8157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bead1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b80c7bf0 con 0x7f45b80ce4e0 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bead1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b80c7ed0 con 0x7f45b80ce0d0 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bead1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f45b80ce8f0 con 0x7f45b80cdaa0 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bd06e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f45b80ce4e0 0x7f45b80ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60062/0 (socket says 172.21.15.42:60062) 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bd06e640 1 -- 172.21.15.42:0/1641106256 learned_addr learned my addr 172.21.15.42:0/1641106256 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bc86d640 1 --2- 172.21.15.42:0/1641106256 >> v2:172.21.15.181:3300/0 conn(0x7f45b80cdaa0 0x7f45b8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181315349 0 0) 0x7f45b80c7bf0 con 0x7f45b80ce4e0 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a4003520 con 0x7f45b80ce4e0 2024-05-09T01:41:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451015785 0 0) 0x7f45b80c7ed0 con 0x7f45b80ce0d0 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45b80c7bf0 con 0x7f45b80ce0d0 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281499786 0 0) 0x7f45a4003520 con 0x7f45b80ce4e0 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 >> v2:172.21.15.181:3300/0 conn(0x7f45b80cdaa0 msgr2=0x7f45b8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 --2- 172.21.15.42:0/1641106256 >> v2:172.21.15.181:3300/0 conn(0x7f45b80cdaa0 0x7f45b8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 >> v1:172.21.15.181:6789/0 conn(0x7f45b80ce0d0 legacy=0x7f45b8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80c81b0 con 0x7f45b80ce4e0 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f45a00016f0 con 0x7f45b80ce4e0 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45bc86d640 1 --2- 172.21.15.42:0/1641106256 >> v2:172.21.15.181:3300/0 conn(0x7f45b80cdaa0 0x7f45b8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 >> v1:172.21.15.42:6789/0 conn(0x7f45b80ce4e0 legacy=0x7f45b80ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a4003c30 0x7f45a4004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45a4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4005280 0x7f45a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45a400c200 con 0x7f45a4004800 2024-05-09T01:41:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45a400c3b0 con 0x7f45a4005280 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.935+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45a400c5b0 con 0x7f45a4003c30 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45a4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45bc86d640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a4003c30 0x7f45a4004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45bd06e640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4005280 0x7f45a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45b7fff640 1 -- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a4003c30 msgr2=0x7f45a4004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a4003c30 0x7f45a4004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45b7fff640 1 -- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4005280 msgr2=0x7f45a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4005280 0x7f45a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45bd06e640 1 -- 172.21.15.42:0/1641106256 reap_dead start 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.936+0000 7f45b7fff640 1 -- 172.21.15.42:0/1641106256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4003520 con 0x7f45a4004800 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45a4004c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f45a8002000 tx=0x7f45a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d37865e7d3417 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8001c20 con 0x7f45a4004800 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a8006d70 con 0x7f45a4004800 2024-05-09T01:41:37.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45b77fe640 1 -- 172.21.15.42:0/1641106256 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8003bb0 con 0x7f45a4004800 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45bead1640 1 -- 172.21.15.42:0/1641106256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 msgr2=0x7f45a4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45bead1640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45a4004c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f45a8002000 tx=0x7f45a4005830 comp rx=0 tx=0).stop 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45bead1640 1 -- 172.21.15.42:0/1641106256 shutdown_connections 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45bead1640 1 --2- 172.21.15.42:0/1641106256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45a4004c10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.937+0000 7f45bead1640 1 -- 172.21.15.42:0/1641106256 >> 172.21.15.42:0/1641106256 conn(0x7f45b8068610 msgr2=0x7f45b8068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.938+0000 7f45bead1640 1 -- 172.21.15.42:0/1641106256 shutdown_connections 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.938+0000 7f45bead1640 1 -- 172.21.15.42:0/1641106256 wait complete. 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.939+0000 7f45bead1640 1 Processor -- start 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.939+0000 7f45bead1640 1 -- start start 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45b81f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b8153ac0 0x7f45b81e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b81f6800 0x7f45b81f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80c8770 con 0x7f45a4004800 2024-05-09T01:41:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80c79a0 con 0x7f45b8153ac0 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45b8160470 con 0x7f45b81f6800 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45b81f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45b81f3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34038/0 (socket says 172.21.15.42:34038) 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 -- 172.21.15.42:0/1643064353 learned_addr learned my addr 172.21.15.42:0/1643064353 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bd06e640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b81f6800 0x7f45b81f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b8153ac0 0x7f45b81e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 -- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b81f6800 msgr2=0x7f45b81f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b81f6800 0x7f45b81f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 -- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b8153ac0 msgr2=0x7f45b81e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b8153ac0 0x7f45b81e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 -- 172.21.15.42:0/1643064353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81f3ec0 con 0x7f45a4004800 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b8153ac0 0x7f45b81e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bd06e640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b81f6800 0x7f45b81f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bc86d640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45b81f3980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f45b0011d00 tx=0x7f45b000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b000fd20 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0004020 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b80cb720 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0004410 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.941+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b80cbce0 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.942+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b80c74e0 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.943+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45b0012040 con 0x7f45a4004800 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.944+0000 7f45b57fa640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f45980762d0 0x7f45980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.944+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f45b0097940 con 0x7f45a4004800 2024-05-09T01:41:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.944+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f45980762d0 0x7f45980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.944+0000 7f45b7fff640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f45980762d0 0x7f45980787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f45a8031000 tx=0x7f45a8033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:37.948+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45b0019030 con 0x7f45a4004800 2024-05-09T01:41:38.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.181+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45b80cd880 con 0x7f45a4004800 2024-05-09T01:41:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.181+0000 7f45b57fa640 1 -- 172.21.15.42:0/1643064353 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f45b0061210 con 0x7f45a4004800 2024-05-09T01:41:38.179 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:38.180 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:41:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:41:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f45980762d0 msgr2=0x7f45980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f45980762d0 0x7f45980787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f45a8031000 tx=0x7f45a8033040 comp rx=0 tx=0).stop 2024-05-09T01:41:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 msgr2=0x7f45b81f3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45b81f3980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f45b0011d00 tx=0x7f45b000f610 comp rx=0 tx=0).stop 2024-05-09T01:41:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 shutdown_connections 2024-05-09T01:41:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f45980762d0 0x7f45980787e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b81f6800 0x7f45b81f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b8153ac0 0x7f45b81e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 --2- 172.21.15.42:0/1643064353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45a4004800 0x7f45b81f3980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 >> 172.21.15.42:0/1643064353 conn(0x7f45b8068610 msgr2=0x7f45b81e7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 shutdown_connections 2024-05-09T01:41:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.184+0000 7f45bead1640 1 -- 172.21.15.42:0/1643064353 wait complete. 2024-05-09T01:41:38.192 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:41:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.310+0000 7f1125e70640 1 Processor -- start 2024-05-09T01:41:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.310+0000 7f1125e70640 1 -- start start 2024-05-09T01:41:38.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f1125e70640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11200cdaa0 0x7f1120157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f1125e70640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11200ce0d0 0x7f11200ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f1125e70640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1120160990 0x7f1120160da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f1125e70640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f11200c79a0 con 0x7f11200ce0d0 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f1125e70640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f11200c7bf0 con 0x7f11200cdaa0 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f1125e70640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11200c7ed0 con 0x7f1120160990 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11200ce0d0 0x7f11200ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11200ce0d0 0x7f11200ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34044/0 (socket says 172.21.15.42:34044) 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 -- 172.21.15.42:0/1405217599 learned_addr learned my addr 172.21.15.42:0/1405217599 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111ffff640 1 --2- 172.21.15.42:0/1405217599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1120160990 0x7f1120160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111f7fe640 1 --2- 172.21.15.42:0/1405217599 >> v2:172.21.15.181:3300/0 conn(0x7f11200cdaa0 0x7f1120157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 -- 172.21.15.42:0/1405217599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1120160990 msgr2=0x7f1120160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:38.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 --2- 172.21.15.42:0/1405217599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1120160990 0x7f1120160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 -- 172.21.15.42:0/1405217599 >> v2:172.21.15.181:3300/0 conn(0x7f11200cdaa0 msgr2=0x7f1120157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:38.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 --2- 172.21.15.42:0/1405217599 >> v2:172.21.15.181:3300/0 conn(0x7f11200cdaa0 0x7f1120157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.312+0000 7f111effd640 1 -- 172.21.15.42:0/1405217599 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11200c81b0 con 0x7f11200ce0d0 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.313+0000 7f111effd640 1 --2- 172.21.15.42:0/1405217599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200ce0d0 0x7f11200ce4e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11200cf710 tx=0x7f111402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57043bf6523ebb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.313+0000 7f111e7fc640 1 -- 172.21.15.42:0/1405217599 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114037070 con 0x7f11200ce0d0 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.313+0000 7f111e7fc640 1 -- 172.21.15.42:0/1405217599 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114032440 con 0x7f11200ce0d0 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.313+0000 7f111e7fc640 1 -- 172.21.15.42:0/1405217599 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114032810 con 0x7f11200ce0d0 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 -- 172.21.15.42:0/1405217599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200ce0d0 msgr2=0x7f11200ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 --2- 172.21.15.42:0/1405217599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200ce0d0 0x7f11200ce4e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11200cf710 tx=0x7f111402a1e0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 -- 172.21.15.42:0/1405217599 shutdown_connections 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 --2- 172.21.15.42:0/1405217599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1120160990 0x7f1120160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 --2- 172.21.15.42:0/1405217599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200ce0d0 0x7f11200ce4e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 --2- 172.21.15.42:0/1405217599 >> v2:172.21.15.181:3300/0 conn(0x7f11200cdaa0 0x7f1120157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 -- 172.21.15.42:0/1405217599 >> 172.21.15.42:0/1405217599 conn(0x7f1120068610 msgr2=0x7f1120068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 -- 172.21.15.42:0/1405217599 shutdown_connections 2024-05-09T01:41:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.314+0000 7f1125e70640 1 -- 172.21.15.42:0/1405217599 wait complete. 2024-05-09T01:41:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.315+0000 7f1125e70640 1 Processor -- start 2024-05-09T01:41:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.316+0000 7f1125e70640 1 -- start start 2024-05-09T01:41:38.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f1125e70640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11200cdaa0 0x7f1120158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f1125e70640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11200ce0d0 0x7f112014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f1125e70640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 0x7f11200d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f1125e70640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1120160470 con 0x7f1120160990 2024-05-09T01:41:38.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f1125e70640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11200c8770 con 0x7f11200ce0d0 2024-05-09T01:41:38.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f1125e70640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11200ceb00 con 0x7f11200cdaa0 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 0x7f11200d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 0x7f11200d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34052/0 (socket says 172.21.15.42:34052) 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 -- 172.21.15.42:0/2438071179 learned_addr learned my addr 172.21.15.42:0/2438071179 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111f7fe640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11200cdaa0 0x7f1120158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111effd640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11200ce0d0 0x7f112014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 -- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11200cdaa0 msgr2=0x7f1120158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11200cdaa0 0x7f1120158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 -- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11200ce0d0 msgr2=0x7f112014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11200ce0d0 0x7f112014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111ffff640 1 -- 172.21.15.42:0/2438071179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1120158690 con 0x7f1120160990 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.317+0000 7f111effd640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11200ce0d0 0x7f112014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.318+0000 7f111ffff640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 0x7f11200d1050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1118009fd0 tx=0x7f111800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.318+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118014420 con 0x7f1120160990 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.318+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1118019070 con 0x7f1120160990 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.318+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11201f6570 con 0x7f1120160990 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.318+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201f6b30 con 0x7f1120160990 2024-05-09T01:41:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.318+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118014800 con 0x7f1120160990 2024-05-09T01:41:38.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.319+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11201f62e0 con 0x7f1120160990 2024-05-09T01:41:38.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.320+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f11180149a0 con 0x7f1120160990 2024-05-09T01:41:38.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.320+0000 7f1107fff640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f110c0762d0 0x7f110c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.321+0000 7f111f7fe640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f110c0762d0 0x7f110c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.321+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f11180963a0 con 0x7f1120160990 2024-05-09T01:41:38.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.321+0000 7f111f7fe640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f110c0762d0 0x7f110c0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f111000a9b0 tx=0x7f1110008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:38.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.326+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f11180616c0 con 0x7f1120160990 2024-05-09T01:41:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.518+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11200c74e0 con 0x7f1120160990 2024-05-09T01:41:38.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.519+0000 7f1107fff640 1 -- 172.21.15.42:0/2438071179 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f1118060fc0 con 0x7f1120160990 2024-05-09T01:41:38.516 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:38.517 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:00.734921+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:41:38.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f110c0762d0 msgr2=0x7f110c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f110c0762d0 0x7f110c0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f111000a9b0 tx=0x7f1110008040 comp rx=0 tx=0).stop 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 msgr2=0x7f11200d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 0x7f11200d1050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1118009fd0 tx=0x7f111800e4b0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 shutdown_connections 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f110c0762d0 0x7f110c0787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1120160990 0x7f11200d1050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11200ce0d0 0x7f112014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 --2- 172.21.15.42:0/2438071179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11200cdaa0 0x7f1120158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 >> 172.21.15.42:0/2438071179 conn(0x7f1120068610 msgr2=0x7f11200b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 shutdown_connections 2024-05-09T01:41:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.521+0000 7f1125e70640 1 -- 172.21.15.42:0/2438071179 wait complete. 2024-05-09T01:41:38.530 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-05-09T01:41:38.649 INFO:teuthology.orchestra.run.smithi042.stdout:{"run_dir":"/var/run/ceph"} 2024-05-09T01:41:38.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-09T01:41:38.650 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1722 2024-05-09T01:41:38.650 DEBUG:tasks.quiescer:Yielding 2024-05-09T01:41:38.650 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T01:41:38.662 INFO:tasks.workunit:Pulling workunits from ref c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:41:38.662 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T01:41:38.662 INFO:tasks.workunit:timeout=3h 2024-05-09T01:41:38.662 INFO:tasks.workunit:cleanup=True 2024-05-09T01:41:38.663 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:38.663 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-09 01:41:04.736514166 +0000 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-09 01:41:36.267143570 +0000 2024-05-09T01:41:38.681 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-05-09T01:41:38.682 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T01:41:38.682 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T01:41:38.758 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T01:41:38.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.783+0000 7f99bc205640 1 Processor -- start 2024-05-09T01:41:38.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.784+0000 7f99bc205640 1 -- start start 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.785+0000 7f99bc205640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99b40ca870 0x7f99b4151530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.785+0000 7f99bc205640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b415c6f0 0x7f99b415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.785+0000 7f99bc205640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b40c5a10 con 0x7f99b4071c60 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.785+0000 7f99bc205640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f99b40c57c0 con 0x7f99b40ca870 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.785+0000 7f99bc205640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f99b40c5fd0 con 0x7f99b415c6f0 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b9fa1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99b40ca870 0x7f99b4151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99ba7a2640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b415c6f0 0x7f99b415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b97a0640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f99b4071c60 0x7f99b415bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:38424/0 (socket says 172.21.15.42:38424) 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b97a0640 1 -- 172.21.15.42:0/3471641837 learned_addr learned my addr 172.21.15.42:0/3471641837 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:38.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b8f9f640 1 -- 172.21.15.42:0/3471641837 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544700409 0 0) 0x7f99b40c5a10 con 0x7f99b4071c60 2024-05-09T01:41:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b8f9f640 1 -- 172.21.15.42:0/3471641837 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99a0003520 con 0x7f99b4071c60 2024-05-09T01:41:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b9fa1640 1 -- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b415c6f0 msgr2=0x7f99b415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b9fa1640 1 --2- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b415c6f0 0x7f99b415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b9fa1640 1 -- 172.21.15.42:0/3471641837 >> v1:172.21.15.181:6789/0 conn(0x7f99b4071c60 legacy=0x7f99b415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99b9fa1640 1 -- 172.21.15.42:0/3471641837 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b40c5cf0 con 0x7f99b40ca870 2024-05-09T01:41:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.786+0000 7f99ba7a2640 1 --2- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b415c6f0 0x7f99b415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.787+0000 7f99b9fa1640 1 --2- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b4151530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99b00097d0 tx=0x7f99b002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f425b0c55c5df629 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.787+0000 7f99b8f9f640 1 -- 172.21.15.42:0/3471641837 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0037070 con 0x7f99b40ca870 2024-05-09T01:41:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.787+0000 7f99b8f9f640 1 -- 172.21.15.42:0/3471641837 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b002ae40 con 0x7f99b40ca870 2024-05-09T01:41:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.787+0000 7f99b8f9f640 1 -- 172.21.15.42:0/3471641837 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0032660 con 0x7f99b40ca870 2024-05-09T01:41:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 -- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 msgr2=0x7f99b4151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 --2- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b4151530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99b00097d0 tx=0x7f99b002a130 comp rx=0 tx=0).stop 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 -- 172.21.15.42:0/3471641837 shutdown_connections 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 --2- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b415c6f0 0x7f99b415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 --2- 172.21.15.42:0/3471641837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b4151530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 -- 172.21.15.42:0/3471641837 >> 172.21.15.42:0/3471641837 conn(0x7f99b4072580 msgr2=0x7f99b4072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 -- 172.21.15.42:0/3471641837 shutdown_connections 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.788+0000 7f99bc205640 1 -- 172.21.15.42:0/3471641837 wait complete. 2024-05-09T01:41:38.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.790+0000 7f99bc205640 1 Processor -- start 2024-05-09T01:41:38.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.790+0000 7f99bc205640 1 -- start start 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.791+0000 7f99bc205640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b4071c60 0x7f99b414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.791+0000 7f99bc205640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.791+0000 7f99bc205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 0x7f99b406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.791+0000 7f99bc205640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99b415e620 con 0x7f99b415c6f0 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.791+0000 7f99bc205640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f99b40cad40 con 0x7f99b40ca870 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.791+0000 7f99bc205640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f99b415e7a0 con 0x7f99b4071c60 2024-05-09T01:41:38.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 0x7f99b406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 0x7f99b406e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34062/0 (socket says 172.21.15.42:34062) 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 -- 172.21.15.42:0/3266022802 learned_addr learned my addr 172.21.15.42:0/3266022802 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99b97a0640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99b9fa1640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b4071c60 0x7f99b414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 -- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b4071c60 msgr2=0x7f99b414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b4071c60 0x7f99b414f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 -- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 msgr2=0x7f99b406db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b406db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 -- 172.21.15.42:0/3266022802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b40cd290 con 0x7f99b415c6f0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99ba7a2640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 0x7f99b406e4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009e10 tx=0x7f99ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac018020 con 0x7f99b415c6f0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ac014480 con 0x7f99b415c6f0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.792+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac014850 con 0x7f99b415c6f0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.793+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b414f980 con 0x7f99b415c6f0 2024-05-09T01:41:38.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.793+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b40cc510 con 0x7f99b415c6f0 2024-05-09T01:41:38.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.793+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b40c50e0 con 0x7f99b415c6f0 2024-05-09T01:41:38.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.795+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f99ac005d10 con 0x7f99b415c6f0 2024-05-09T01:41:38.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.795+0000 7f99aa7fc640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f9998076300 0x7f9998078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:38.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.795+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99ac0988a0 con 0x7f99b415c6f0 2024-05-09T01:41:38.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.795+0000 7f99b9fa1640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f9998076300 0x7f9998078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:38.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.796+0000 7f99b9fa1640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f9998076300 0x7f9998078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99b0034000 tx=0x7f99b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:38.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:38.799+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99ac022030 con 0x7f99b415c6f0 2024-05-09T01:41:38.798 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T01:41:39.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.031+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99b40cb050 con 0x7f99b415c6f0 2024-05-09T01:41:39.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.031+0000 7f99aa7fc640 1 -- 172.21.15.42:0/3266022802 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f99ac010040 con 0x7f99b415c6f0 2024-05-09T01:41:39.029 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:39.029 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:41:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f9998076300 msgr2=0x7f9998078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f9998076300 0x7f9998078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99b0034000 tx=0x7f99b002e000 comp rx=0 tx=0).stop 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 msgr2=0x7f99b406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 0x7f99b406e4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009e10 tx=0x7f99ac00c490 comp rx=0 tx=0).stop 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 shutdown_connections 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f9998076300 0x7f9998078810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b415c6f0 0x7f99b406e4f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b40ca870 0x7f99b406db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 --2- 172.21.15.42:0/3266022802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99b4071c60 0x7f99b414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 >> 172.21.15.42:0/3266022802 conn(0x7f99b4072580 msgr2=0x7f99b415cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 shutdown_connections 2024-05-09T01:41:39.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.033+0000 7f99bc205640 1 -- 172.21.15.42:0/3266022802 wait complete. 2024-05-09T01:41:39.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T01:40:59.137449+0000', 'modified': '2024-05-09T01:41:27.292881+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4287, 'mds_2': 4253, 'mds_3': 4247, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 4, 'incarnation': 15, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.42:6837/3957323768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 3957323768}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 3957323768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4247': {'gid': 4247, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6835/1600205649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1600205649}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1600205649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4253': {'gid': 4253, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/2888840633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2888840633}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2888840633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.42:6835/1138022510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1138022510}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1138022510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6837/1961479918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 1961479918}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 1961479918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4241, 4247, 4253, 4287, 4311]} 2024-05-09T01:41:39.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-09T01:41:39.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-09T01:41:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.771+0000 7f91d84f9640 1 Processor -- start 2024-05-09T01:41:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.771+0000 7f91d84f9640 1 -- start start 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d84f9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d84f9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f91d00cd270 0x7f91d00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d84f9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d00ce880 con 0x7f91d006e990 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d84f9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f91d00ccb00 con 0x7f91d00cd270 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d84f9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f91d00ccde0 con 0x7f91d00c7020 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d5a94640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f91d006e990 0x7f91d006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60070/0 (socket says 172.21.15.42:60070) 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d5a94640 1 -- 172.21.15.42:0/1111704407 learned_addr learned my addr 172.21.15.42:0/1111704407 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d6a96640 1 --2- 172.21.15.42:0/1111704407 >> v2:172.21.15.181:3300/0 conn(0x7f91d00cd270 0x7f91d00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d6295640 1 --2- 172.21.15.42:0/1111704407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d5293640 1 -- 172.21.15.42:0/1111704407 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785187224 0 0) 0x7f91d00ce880 con 0x7f91d006e990 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d5293640 1 -- 172.21.15.42:0/1111704407 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91b8003520 con 0x7f91d006e990 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d5293640 1 -- 172.21.15.42:0/1111704407 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 894450482 0 0) 0x7f91b8003520 con 0x7f91d006e990 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d6295640 1 -- 172.21.15.42:0/1111704407 >> v2:172.21.15.181:3300/0 conn(0x7f91d00cd270 msgr2=0x7f91d00cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d6295640 1 --2- 172.21.15.42:0/1111704407 >> v2:172.21.15.181:3300/0 conn(0x7f91d00cd270 0x7f91d00cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.773+0000 7f91d6295640 1 -- 172.21.15.42:0/1111704407 >> v1:172.21.15.42:6789/0 conn(0x7f91d006e990 legacy=0x7f91d006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.774+0000 7f91d6295640 1 -- 172.21.15.42:0/1111704407 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d015d7f0 con 0x7f91d00c7020 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.774+0000 7f91d6a96640 1 --2- 172.21.15.42:0/1111704407 >> v2:172.21.15.181:3300/0 conn(0x7f91d00cd270 0x7f91d00cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.774+0000 7f91d6295640 1 --2- 172.21.15.42:0/1111704407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0156d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009d90 tx=0x7f91c002a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53485b1919897c40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d5293640 1 -- 172.21.15.42:0/1111704407 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c40016f0 con 0x7f91d00c7020 2024-05-09T01:41:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d5293640 1 -- 172.21.15.42:0/1111704407 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0007540 con 0x7f91d00c7020 2024-05-09T01:41:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d5293640 1 -- 172.21.15.42:0/1111704407 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c00078f0 con 0x7f91d00c7020 2024-05-09T01:41:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 -- 172.21.15.42:0/1111704407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 msgr2=0x7f91d0156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 --2- 172.21.15.42:0/1111704407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0156d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009d90 tx=0x7f91c002a560 comp rx=0 tx=0).stop 2024-05-09T01:41:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 -- 172.21.15.42:0/1111704407 shutdown_connections 2024-05-09T01:41:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 --2- 172.21.15.42:0/1111704407 >> v2:172.21.15.181:3300/0 conn(0x7f91d00cd270 0x7f91d00cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 --2- 172.21.15.42:0/1111704407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0156d40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 -- 172.21.15.42:0/1111704407 >> 172.21.15.42:0/1111704407 conn(0x7f91d0068ef0 msgr2=0x7f91d00d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 -- 172.21.15.42:0/1111704407 shutdown_connections 2024-05-09T01:41:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.775+0000 7f91d84f9640 1 -- 172.21.15.42:0/1111704407 wait complete. 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.777+0000 7f91d84f9640 1 Processor -- start 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.777+0000 7f91d84f9640 1 -- start start 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d84f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 0x7f91d015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d84f9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d84f9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00cd270 0x7f91d014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d84f9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91d015da90 con 0x7f91d006e990 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d84f9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f91d00ce5a0 con 0x7f91d00cd270 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d84f9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f91d00cdbc0 con 0x7f91d00c7020 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.778+0000 7f91d6295640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 0x7f91d015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 0x7f91d015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34074/0 (socket says 172.21.15.42:34074) 2024-05-09T01:41:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 -- 172.21.15.42:0/221709273 learned_addr learned my addr 172.21.15.42:0/221709273 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6a96640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00cd270 0x7f91d014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d5a94640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 -- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 msgr2=0x7f91d0151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 -- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00cd270 msgr2=0x7f91d014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00cd270 0x7f91d014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 -- 172.21.15.42:0/221709273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d01516c0 con 0x7f91d006e990 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d5a94640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d6295640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 0x7f91d015ba60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91c002ab50 tx=0x7f91c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91ceffd640 1 -- 172.21.15.42:0/221709273 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0009450 con 0x7f91d006e990 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91ceffd640 1 -- 172.21.15.42:0/221709273 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0004240 con 0x7f91d006e990 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d015b4a0 con 0x7f91d006e990 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91ceffd640 1 -- 172.21.15.42:0/221709273 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c00045f0 con 0x7f91d006e990 2024-05-09T01:41:39.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.779+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d0150980 con 0x7f91d006e990 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.781+0000 7f91ceffd640 1 -- 172.21.15.42:0/221709273 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91c0039040 con 0x7f91d006e990 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.782+0000 7f91ceffd640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91bc0762d0 0x7f91bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.782+0000 7f91ceffd640 1 -- 172.21.15.42:0/221709273 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91c00b8c40 con 0x7f91d006e990 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.782+0000 7f91d5a94640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91bc0762d0 0x7f91bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.783+0000 7f91d5a94640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91bc0762d0 0x7f91bc0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91d015b2b0 tx=0x7f91c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.783+0000 7f91df3ae740 1 Processor -- start 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.783+0000 7f91df3ae740 1 -- start start 2024-05-09T01:41:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91270c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b912542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91df3ae740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b911924e0 con 0x563b90e8a270 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b9112dff0 con 0x563b90e69590 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b9118e4a0 con 0x563b90e613b0 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91d6295640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91270c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91d6295640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91270c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34086/0 (socket says 172.21.15.42:34086) 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91d6295640 1 -- 172.21.15.42:0/209476266 learned_addr learned my addr 172.21.15.42:0/209476266 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91d6a96640 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.784+0000 7f91d5a94640 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b912542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91d6295640 1 -- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 msgr2=0x563b912542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91d6295640 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b912542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91d6295640 1 -- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 msgr2=0x563b912547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91d6295640 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91d6295640 1 -- 172.21.15.42:0/209476266 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b91114720 con 0x563b90e8a270 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91d6295640 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91270c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000f80 tx=0x7f91c0081880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8850869c9c2b561b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91b7fff640 1 -- 172.21.15.42:0/209476266 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0081e00 con 0x563b90e8a270 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91b7fff640 1 -- 172.21.15.42:0/209476266 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c00861b0 con 0x563b90e8a270 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.785+0000 7f91b7fff640 1 -- 172.21.15.42:0/209476266 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c008abd0 con 0x563b90e8a270 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 -- 172.21.15.42:0/209476266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 msgr2=0x563b91270c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91270c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000f80 tx=0x7f91c0081880 comp rx=0 tx=0).stop 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 -- 172.21.15.42:0/209476266 shutdown_connections 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b912542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 --2- 172.21.15.42:0/209476266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91270c80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 -- 172.21.15.42:0/209476266 >> 172.21.15.42:0/209476266 conn(0x563b90e7e3c0 msgr2=0x563b9122e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 -- 172.21.15.42:0/209476266 shutdown_connections 2024-05-09T01:41:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.786+0000 7f91df3ae740 1 -- 172.21.15.42:0/209476266 wait complete. 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.787+0000 7f91df3ae740 1 -- start start 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.787+0000 7f91df3ae740 1 Processor -- start 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b9126b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 0x563b91283b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e8a270 0x563b912840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b9122e700 con 0x563b90e69590 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b91119760 con 0x563b90e8a270 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b911924e0 con 0x563b90e613b0 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.788+0000 7f91df3ae740 10 client.0 _ll_register_callbacks cb 0x563b9113c4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 0x563b91283b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 0x563b91283b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34098/0 (socket says 172.21.15.42:34098) 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 -- 172.21.15.42:0/1471275148 learned_addr learned my addr 172.21.15.42:0/1471275148 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d6a96640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e8a270 0x563b912840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d6295640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b9126b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 -- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 msgr2=0x563b9126b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b9126b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 -- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e8a270 msgr2=0x563b912840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e8a270 0x563b912840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 -- 172.21.15.42:0/1471275148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b9115abd0 con 0x563b90e69590 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91d5a94640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 0x563b91283b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000fd0 tx=0x7f91c4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bae360b6616777 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91b57fa640 1 -- 172.21.15.42:0/1471275148 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4027060 con 0x563b90e69590 2024-05-09T01:41:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c00861b0 con 0x563b90e69590 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91b57fa640 1 -- 172.21.15.42:0/1471275148 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91c4022b00 con 0x563b90e69590 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91b57fa640 1 -- 172.21.15.42:0/1471275148 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f91c4022d40 con 0x563b90e69590 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91df3ae740 10 client.4812 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.789+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563b91140280 con 0x563b90e69590 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91b57fa640 1 -- 172.21.15.42:0/1471275148 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c00861b0 con 0x563b90e69590 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91b57fa640 1 -- 172.21.15.42:0/1471275148 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f91c4022760 con 0x563b90e69590 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91df3ae740 10 client.4812 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91df3ae740 10 client.4812 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91df3ae740 20 client.4812 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91df3ae740 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b90e48e40 0x563b9128edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91df3ae740 4 client.4812 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 --> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b911a00f0 con 0x563b90e48e40 2024-05-09T01:41:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91d6295640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b90e48e40 0x563b9128edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91b57fa640 10 client.4812 ms_handle_connect on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.790+0000 7f91d6295640 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b90e48e40 0x563b9128edd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=57265734cfb6b450 server_cookie=2fd922e0f19dec6b in_seq=0 out_seq=0 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91b57fa640 1 -- 172.21.15.42:0/1471275148 <== mds.4 v2:172.21.15.42:6836/3957323768 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b911a00f0 con 0x563b90e48e40 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91b57fa640 10 client.4812 handle_command_reply: tid=0 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 client.4812 shutdown 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 msgr2=0x563b91283b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 0x563b91283b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000fd0 tx=0x7f91c4000ed0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 shutdown_connections 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b90e48e40 0x563b9128edd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e8a270 0x563b912840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e69590 0x563b91283b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 --2- 172.21.15.42:0/1471275148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b9126b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91b57fa640 0 client.4812 ms_handle_reset on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 >> 172.21.15.42:0/1471275148 conn(0x563b90e7e3c0 msgr2=0x563b9122a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.791+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 shutdown_connections 2024-05-09T01:41:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.792+0000 7f91df3ae740 1 -- 172.21.15.42:0/1471275148 wait complete. 2024-05-09T01:41:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.792+0000 7f91df3ae740 20 client.4812 trim_cache size 0 max 16384 2024-05-09T01:41:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.811+0000 7f91df3ae740 1 Processor -- start 2024-05-09T01:41:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.811+0000 7f91df3ae740 1 -- start start 2024-05-09T01:41:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b91230f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b91279970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91279eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91df3ae740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91d00d0170 con 0x563b90e8a270 2024-05-09T01:41:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b91273bb0 con 0x563b90e69590 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b91278560 con 0x563b90e613b0 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91279eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91279eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34110/0 (socket says 172.21.15.42:34110) 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 -- 172.21.15.42:0/3572576745 learned_addr learned my addr 172.21.15.42:0/3572576745 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d5a94640 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b91279970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6295640 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b91230f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 -- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 msgr2=0x563b91230f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b91230f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 -- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 msgr2=0x563b91279970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b91279970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.812+0000 7f91d6a96640 1 -- 172.21.15.42:0/3572576745 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b90ef5850 con 0x563b90e8a270 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.813+0000 7f91d5a94640 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b91279970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.813+0000 7f91d6a96640 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91279eb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009da0 tx=0x7f91c8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5861635ee201b7b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.813+0000 7f91b77fe640 1 -- 172.21.15.42:0/3572576745 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8004220 con 0x563b90e8a270 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.813+0000 7f91b77fe640 1 -- 172.21.15.42:0/3572576745 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c80043c0 con 0x563b90e8a270 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.813+0000 7f91b77fe640 1 -- 172.21.15.42:0/3572576745 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8003850 con 0x563b90e8a270 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 -- 172.21.15.42:0/3572576745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 msgr2=0x563b91279eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91279eb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009da0 tx=0x7f91c8009190 comp rx=0 tx=0).stop 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 -- 172.21.15.42:0/3572576745 shutdown_connections 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e8a270 0x563b91279eb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b91279970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 --2- 172.21.15.42:0/3572576745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e613b0 0x563b91230f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 -- 172.21.15.42:0/3572576745 >> 172.21.15.42:0/3572576745 conn(0x563b90e7e3c0 msgr2=0x563b912786e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 -- 172.21.15.42:0/3572576745 shutdown_connections 2024-05-09T01:41:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 -- 172.21.15.42:0/3572576745 wait complete. 2024-05-09T01:41:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.814+0000 7f91df3ae740 1 -- start start 2024-05-09T01:41:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.815+0000 7f91df3ae740 1 Processor -- start 2024-05-09T01:41:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 0x563b912683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912f1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e8a270 0x563b91287190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b9126d8f0 con 0x563b90e613b0 2024-05-09T01:41:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563b9126af60 con 0x563b90e69590 2024-05-09T01:41:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563b91280360 con 0x563b90e8a270 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91df3ae740 10 client.0 _ll_register_callbacks cb 0x7f91c4007e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 0x563b912683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 0x563b912683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34112/0 (socket says 172.21.15.42:34112) 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 -- 172.21.15.42:0/2588559828 learned_addr learned my addr 172.21.15.42:0/2588559828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d5a94640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6a96640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e8a270 0x563b91287190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 -- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e8a270 msgr2=0x563b91287190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e8a270 0x563b91287190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 -- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 msgr2=0x563b912f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6295640 1 -- 172.21.15.42:0/2588559828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b90f6c6b0 con 0x563b90e613b0 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.816+0000 7f91d6a96640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e8a270 0x563b91287190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91d6295640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 0x563b912683b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f91c0081ab0 tx=0x7f91c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9806c8a36d3f53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91b57fa640 1 -- 172.21.15.42:0/2588559828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0092060 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91b57fa640 1 -- 172.21.15.42:0/2588559828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91c008a740 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c80043c0 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91b57fa640 1 -- 172.21.15.42:0/2588559828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f91c00861b0 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 10 client.4818 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563b9114e630 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91b57fa640 1 -- 172.21.15.42:0/2588559828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c80043c0 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91b57fa640 1 -- 172.21.15.42:0/2588559828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f91c004c030 con 0x563b90e613b0 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 10 client.4818 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 10 client.4818 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 20 client.4818 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b912edd90 0x563b912ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 4 client.4818 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:39.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 --> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] -- command(tid 0: {"prefix": "status"}) -- 0x563b91199f60 con 0x563b912edd90 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.817+0000 7f91d5a94640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b912edd90 0x563b912ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91b57fa640 10 client.4818 ms_handle_connect on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91d5a94640 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b912edd90 0x563b912ee1a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a8c7c7aa84eeb11a server_cookie=633ecc85d2d11d3 in_seq=0 out_seq=0 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91b57fa640 1 -- 172.21.15.42:0/2588559828 <== mds.4 v2:172.21.15.42:6836/3957323768 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563b91199f60 con 0x563b912edd90 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91b57fa640 10 client.4818 handle_command_reply: tid=0 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 client.4818 shutdown 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 msgr2=0x563b912683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 0x563b912683b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f91c0081ab0 tx=0x7f91c0009750 comp rx=0 tx=0).stop 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 shutdown_connections 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:6836/3957323768,v1:172.21.15.42:6837/3957323768] conn(0x563b912edd90 0x563b912ee1a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563b90e8a270 0x563b91287190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91b57fa640 0 client.4818 ms_handle_reset on v2:172.21.15.42:6836/3957323768 2024-05-09T01:41:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b90e69590 0x563b912f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 --2- 172.21.15.42:0/2588559828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b90e613b0 0x563b912683b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 >> 172.21.15.42:0/2588559828 conn(0x563b90e7e3c0 msgr2=0x563b912786e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 shutdown_connections 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.818+0000 7f91df3ae740 1 -- 172.21.15.42:0/2588559828 wait complete. 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91df3ae740 20 client.4818 trim_cache size 0 max 16384 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-05-09T01:41:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4241, 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 18.537396199, 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 46.108235813999997 2024-05-09T01:41:39.824 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91bc0762d0 msgr2=0x7f91bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91bc0762d0 0x7f91bc0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91d015b2b0 tx=0x7f91c4009040 comp rx=0 tx=0).stop 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 msgr2=0x7f91d015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 0x7f91d015ba60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91c002ab50 tx=0x7f91c0004a40 comp rx=0 tx=0).stop 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 shutdown_connections 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f91bc0762d0 0x7f91bc0787e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00cd270 0x7f91d014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d00c7020 0x7f91d0151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 --2- 172.21.15.42:0/221709273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91d006e990 0x7f91d015ba60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 >> 172.21.15.42:0/221709273 conn(0x7f91d0068ef0 msgr2=0x7f91d00ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 shutdown_connections 2024-05-09T01:41:39.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.819+0000 7f91d84f9640 1 -- 172.21.15.42:0/221709273 wait complete. 2024-05-09T01:41:39.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-09T01:41:39.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.946+0000 7f4db33ee640 1 Processor -- start 2024-05-09T01:41:39.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.947+0000 7f4db33ee640 1 -- start start 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db33ee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db33ee640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4dac1570f0 0x7f4dac0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db33ee640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dac160420 con 0x7f4dac0c9500 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db33ee640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f4dac1612f0 con 0x7f4dac1570f0 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db33ee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac0cc350 con 0x7f4dac0b7ba0 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db198b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4dac1570f0 0x7f4dac0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db118a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4dac0c9500 0x7f4dac0c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60080/0 (socket says 172.21.15.42:60080) 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db118a640 1 -- 172.21.15.42:0/2843491466 learned_addr learned my addr 172.21.15.42:0/2843491466 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db198b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4dac1570f0 0x7f4dac0ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34116/0 (socket says 172.21.15.42:34116) 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db0989640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db198b640 1 -- 172.21.15.42:0/2843491466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 msgr2=0x7f4dac0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db198b640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db198b640 1 -- 172.21.15.42:0/2843491466 >> v1:172.21.15.42:6789/0 conn(0x7f4dac0c9500 legacy=0x7f4dac0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4da3fff640 1 -- 172.21.15.42:0/2843491466 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201534305 0 0) 0x7f4dac160420 con 0x7f4dac0c9500 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db198b640 1 -- 172.21.15.42:0/2843491466 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac1606e0 con 0x7f4dac1570f0 2024-05-09T01:41:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.948+0000 7f4db0989640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:39.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.949+0000 7f4db198b640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac1570f0 0x7f4dac0ca870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4da40097a0 tx=0x7f4da402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd79498375b0edc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.949+0000 7f4da3fff640 1 -- 172.21.15.42:0/2843491466 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4037070 con 0x7f4dac1570f0 2024-05-09T01:41:39.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.949+0000 7f4da3fff640 1 -- 172.21.15.42:0/2843491466 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da4032440 con 0x7f4dac1570f0 2024-05-09T01:41:39.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.949+0000 7f4da3fff640 1 -- 172.21.15.42:0/2843491466 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4032810 con 0x7f4dac1570f0 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 -- 172.21.15.42:0/2843491466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac1570f0 msgr2=0x7f4dac0ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac1570f0 0x7f4dac0ca870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4da40097a0 tx=0x7f4da402a180 comp rx=0 tx=0).stop 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 -- 172.21.15.42:0/2843491466 shutdown_connections 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac1570f0 0x7f4dac0ca870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2843491466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 -- 172.21.15.42:0/2843491466 >> 172.21.15.42:0/2843491466 conn(0x7f4dac0d2100 msgr2=0x7f4dac0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 -- 172.21.15.42:0/2843491466 shutdown_connections 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.950+0000 7f4db33ee640 1 -- 172.21.15.42:0/2843491466 wait complete. 2024-05-09T01:41:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.952+0000 7f4db33ee640 1 Processor -- start 2024-05-09T01:41:39.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.952+0000 7f4db33ee640 1 -- start start 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db33ee640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db33ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 0x7f4dac1e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db33ee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dac1570f0 0x7f4dac15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db33ee640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac160f80 con 0x7f4dac0c9500 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db33ee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac160ca0 con 0x7f4dac1570f0 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db33ee640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac157500 con 0x7f4dac0b7ba0 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db0989640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 0x7f4dac1e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db0989640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 0x7f4dac1e80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34130/0 (socket says 172.21.15.42:34130) 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db0989640 1 -- 172.21.15.42:0/2750743575 learned_addr learned my addr 172.21.15.42:0/2750743575 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.953+0000 7f4db198b640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dac1570f0 0x7f4dac15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db118a640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db0989640 1 -- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 msgr2=0x7f4dac14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db0989640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac14cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db0989640 1 -- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dac1570f0 msgr2=0x7f4dac15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db0989640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dac1570f0 0x7f4dac15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db0989640 1 -- 172.21.15.42:0/2750743575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac15efe0 con 0x7f4dac0c9500 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db198b640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dac1570f0 0x7f4dac15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db0989640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 0x7f4dac1e80a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d800 tx=0x7f4d9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4da1ffb640 1 -- 172.21.15.42:0/2750743575 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c004030 con 0x7f4dac0c9500 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4da1ffb640 1 -- 172.21.15.42:0/2750743575 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c0041d0 con 0x7f4dac0c9500 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dac1e6220 con 0x7f4dac0c9500 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4da1ffb640 1 -- 172.21.15.42:0/2750743575 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00b6c0 con 0x7f4dac0c9500 2024-05-09T01:41:39.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.954+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dac151ee0 con 0x7f4dac0c9500 2024-05-09T01:41:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.956+0000 7f4da1ffb640 1 -- 172.21.15.42:0/2750743575 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d9c00b860 con 0x7f4dac0c9500 2024-05-09T01:41:39.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.956+0000 7f4da1ffb640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d900762d0 0x7f4d900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.956+0000 7f4da1ffb640 1 -- 172.21.15.42:0/2750743575 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4d9c097890 con 0x7f4dac0c9500 2024-05-09T01:41:39.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.956+0000 7f4db118a640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d900762d0 0x7f4d900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.957+0000 7f4db118a640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d900762d0 0x7f4d900787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4da80012e0 tx=0x7f4da8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.957+0000 7f4dba379740 1 Processor -- start 2024-05-09T01:41:39.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.957+0000 7f4dba379740 1 -- start start 2024-05-09T01:41:39.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.958+0000 7f4dba379740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e30aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.958+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2c9b3b0 0x5570e308e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e308e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4dba379740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e2fcc4e0 con 0x5570e2cc4270 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570e2f67ff0 con 0x5570e2c9b3b0 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5570e2fc84a0 con 0x5570e2ca3590 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e30aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e30aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34144/0 (socket says 172.21.15.42:34144) 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 -- 172.21.15.42:0/3216898780 learned_addr learned my addr 172.21.15.42:0/3216898780 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db0989640 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2c9b3b0 0x5570e308e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db198b640 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e308e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 -- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 msgr2=0x5570e308e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e308e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 -- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2c9b3b0 msgr2=0x5570e308e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2c9b3b0 0x5570e308e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 -- 172.21.15.42:0/3216898780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e2f4e720 con 0x5570e2cc4270 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db198b640 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e308e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4db118a640 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e30aac80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4da8005fa0 tx=0x7f4da8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9c848c3313ab18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4d96ffd640 1 -- 172.21.15.42:0/3216898780 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8007510 con 0x5570e2cc4270 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4d96ffd640 1 -- 172.21.15.42:0/3216898780 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da80076b0 con 0x5570e2cc4270 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.959+0000 7f4d96ffd640 1 -- 172.21.15.42:0/3216898780 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8004e30 con 0x5570e2cc4270 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 -- 172.21.15.42:0/3216898780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 msgr2=0x5570e30aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e30aac80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4da8005fa0 tx=0x7f4da8010000 comp rx=0 tx=0).stop 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 -- 172.21.15.42:0/3216898780 shutdown_connections 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e308e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2c9b3b0 0x5570e308e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 --2- 172.21.15.42:0/3216898780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e30aac80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 -- 172.21.15.42:0/3216898780 >> 172.21.15.42:0/3216898780 conn(0x5570e2cb83c0 msgr2=0x5570e30688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 -- 172.21.15.42:0/3216898780 shutdown_connections 2024-05-09T01:41:39.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.960+0000 7f4dba379740 1 -- 172.21.15.42:0/3216898780 wait complete. 2024-05-09T01:41:39.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.961+0000 7f4dba379740 1 -- start start 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.961+0000 7f4dba379740 1 Processor -- start 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e30b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2cc4270 0x5570e30a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e3068700 con 0x5570e2c9b3b0 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570e2f53760 con 0x5570e2ca3590 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5570e30ba550 con 0x5570e2cc4270 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4dba379740 10 client.0 _ll_register_callbacks cb 0x5570e2f764b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.962+0000 7f4db118a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30a55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34150/0 (socket says 172.21.15.42:34150) 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 -- 172.21.15.42:0/3429697567 learned_addr learned my addr 172.21.15.42:0/3429697567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db0989640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e30b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db198b640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2cc4270 0x5570e30a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 -- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2cc4270 msgr2=0x5570e30a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2cc4270 0x5570e30a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 -- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 msgr2=0x5570e30b9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e30b9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 -- 172.21.15.42:0/3429697567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570e2f94bd0 con 0x5570e2c9b3b0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db0989640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e30b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4db118a640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30a55c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4da800d520 tx=0x7f4da8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417abf5cbd68f000 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4d8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4d8bfff640 1 -- 172.21.15.42:0/3429697567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8012610 con 0x5570e2c9b3b0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da80076b0 con 0x5570e2c9b3b0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4d8bfff640 1 -- 172.21.15.42:0/3429697567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4da80127b0 con 0x5570e2c9b3b0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4d8bfff640 1 -- 172.21.15.42:0/3429697567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f4da8034050 con 0x5570e2c9b3b0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4dba379740 10 client.4833 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.963+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5570e2f7a280 con 0x5570e2c9b3b0 2024-05-09T01:41:39.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4d8bfff640 1 -- 172.21.15.42:0/3429697567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da80076b0 con 0x5570e2c9b3b0 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4d8bfff640 1 -- 172.21.15.42:0/3429697567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f4da802b030 con 0x5570e2c9b3b0 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4dba379740 10 client.4833 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4dba379740 10 client.4833 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4dba379740 20 client.4833 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4dba379740 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e2c82e40 0x5570e30c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4dba379740 4 client.4833 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 --> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570e2fda0f0 con 0x5570e2c82e40 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4db0989640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e2c82e40 0x5570e30c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4db0989640 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e2c82e40 0x5570e30c88b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=190bb50a3b070fe1 server_cookie=3426f1fa8115dab4 in_seq=0 out_seq=0 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.964+0000 7f4d8bfff640 10 client.4833 ms_handle_connect on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4d8bfff640 1 -- 172.21.15.42:0/3429697567 <== mds.3 v2:172.21.15.181:6834/1600205649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5570e2fda0f0 con 0x5570e2c82e40 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4d8bfff640 10 client.4833 handle_command_reply: tid=0 2024-05-09T01:41:39.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 client.4833 shutdown 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 msgr2=0x5570e30a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30a55c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4da800d520 tx=0x7f4da8001250 comp rx=0 tx=0).stop 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 shutdown_connections 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e2c82e40 0x5570e30c88b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2cc4270 0x5570e30a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e30b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 --2- 172.21.15.42:0/3429697567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30a55c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4d8bfff640 0 client.4833 ms_handle_reset on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.965+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 >> 172.21.15.42:0/3429697567 conn(0x5570e2cb83c0 msgr2=0x5570e3063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.966+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 shutdown_connections 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.966+0000 7f4dba379740 1 -- 172.21.15.42:0/3429697567 wait complete. 2024-05-09T01:41:39.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.966+0000 7f4dba379740 20 client.4833 trim_cache size 0 max 16384 2024-05-09T01:41:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.985+0000 7f4dba379740 1 Processor -- start 2024-05-09T01:41:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.985+0000 7f4dba379740 1 -- start start 2024-05-09T01:41:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4dba379740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e30643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2cc4270 0x5570e30648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4dba379740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1516d0 con 0x5570e2c9b3b0 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570e30a1f50 con 0x5570e2cc4270 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5570e30a9250 con 0x5570e2ca3590 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34162/0 (socket says 172.21.15.42:34162) 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 -- 172.21.15.42:0/3018400705 learned_addr learned my addr 172.21.15.42:0/3018400705 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 -- 172.21.15.42:0/3018400705 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 msgr2=0x5570e30643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e30643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 -- 172.21.15.42:0/3018400705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2cc4270 msgr2=0x5570e30648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2cc4270 0x5570e30648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 -- 172.21.15.42:0/3018400705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e2d2f850 con 0x5570e2c9b3b0 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4db118a640 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30634d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4da8005fd0 tx=0x7f4da801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6956585ba49dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4d967fc640 1 -- 172.21.15.42:0/3018400705 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8015070 con 0x5570e2c9b3b0 2024-05-09T01:41:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4d967fc640 1 -- 172.21.15.42:0/3018400705 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8018070 con 0x5570e2c9b3b0 2024-05-09T01:41:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.986+0000 7f4d967fc640 1 -- 172.21.15.42:0/3018400705 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8022e60 con 0x5570e2c9b3b0 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 -- 172.21.15.42:0/3018400705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 msgr2=0x5570e30634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30634d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4da8005fd0 tx=0x7f4da801e000 comp rx=0 tx=0).stop 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 -- 172.21.15.42:0/3018400705 shutdown_connections 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2cc4270 0x5570e30648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2ca3590 0x5570e30643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 --2- 172.21.15.42:0/3018400705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2c9b3b0 0x5570e30634d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 -- 172.21.15.42:0/3018400705 >> 172.21.15.42:0/3018400705 conn(0x5570e2cb83c0 msgr2=0x5570e30b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 -- 172.21.15.42:0/3018400705 shutdown_connections 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.987+0000 7f4dba379740 1 -- 172.21.15.42:0/3018400705 wait complete. 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.988+0000 7f4dba379740 1 -- start start 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.988+0000 7f4dba379740 1 Processor -- start 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.989+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2c9b3b0 0x5570e30b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.989+0000 7f4dba379740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e3121580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.989+0000 7f4dba379740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e3121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.989+0000 7f4dba379740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e3091d10 con 0x5570e2cc4270 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.989+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570e30916c0 con 0x5570e2ca3590 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.989+0000 7f4dba379740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5570e30bd270 con 0x5570e2c9b3b0 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4dba379740 10 client.0 _ll_register_callbacks cb 0x7f4da8005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e3121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e3121ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34174/0 (socket says 172.21.15.42:34174) 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 -- 172.21.15.42:0/4087910996 learned_addr learned my addr 172.21.15.42:0/4087910996 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db118a640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2c9b3b0 0x5570e30b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db0989640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e3121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 -- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2c9b3b0 msgr2=0x5570e30b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2c9b3b0 0x5570e30b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 -- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 msgr2=0x5570e3121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e3121580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 -- 172.21.15.42:0/4087910996 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570e2da66b0 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4db198b640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e3121ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4da40098c0 tx=0x7f4da4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6390389a14a8d8e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4d8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4d8bfff640 1 -- 172.21.15.42:0/4087910996 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4037040 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da8018070 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4d8bfff640 1 -- 172.21.15.42:0/4087910996 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4da4032d80 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4d8bfff640 1 -- 172.21.15.42:0/4087910996 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f4da404b050 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4dba379740 10 client.4839 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.990+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5570e2f88630 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4d8bfff640 1 -- 172.21.15.42:0/4087910996 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8018070 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4d8bfff640 1 -- 172.21.15.42:0/4087910996 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f4da404e020 con 0x5570e2cc4270 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4dba379740 10 client.4839 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4dba379740 10 client.4839 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-09T01:41:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4dba379740 20 client.4839 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4dba379740 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e3128180 0x5570e31341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4dba379740 4 client.4839 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 --> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] -- command(tid 0: {"prefix": "status"}) -- 0x5570e2fd3f60 con 0x5570e3128180 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4db118a640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e3128180 0x5570e31341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4d8bfff640 10 client.4839 ms_handle_connect on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.991+0000 7f4db118a640 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e3128180 0x5570e31341d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be70cefe468ae19a server_cookie=d1c8a3c04fce3ed2 in_seq=0 out_seq=0 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4d8bfff640 1 -- 172.21.15.42:0/4087910996 <== mds.3 v2:172.21.15.181:6834/1600205649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5570e2fd3f60 con 0x5570e3128180 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4d8bfff640 10 client.4839 handle_command_reply: tid=0 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 client.4839 shutdown 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 msgr2=0x5570e3121ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e3121ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4da40098c0 tx=0x7f4da4004730 comp rx=0 tx=0).stop 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 shutdown_connections 2024-05-09T01:41:39.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:6834/1600205649,v1:172.21.15.181:6835/1600205649] conn(0x5570e3128180 0x5570e31341d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2cc4270 0x5570e3121ac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570e2ca3590 0x5570e3121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 --2- 172.21.15.42:0/4087910996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5570e2c9b3b0 0x5570e30b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4d8bfff640 0 client.4839 ms_handle_reset on v2:172.21.15.181:6834/1600205649 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 >> 172.21.15.42:0/4087910996 conn(0x5570e2cb83c0 msgr2=0x5570e30634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 shutdown_connections 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 1 -- 172.21.15.42:0/4087910996 wait complete. 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.992+0000 7f4dba379740 20 client.4839 trim_cache size 0 max 16384 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4247, 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 24.158087428999998, 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 46.269734436 2024-05-09T01:41:39.996 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:39.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d900762d0 msgr2=0x7f4d900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d900762d0 0x7f4d900787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4da80012e0 tx=0x7f4da8009040 comp rx=0 tx=0).stop 2024-05-09T01:41:39.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 msgr2=0x7f4dac1e80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:39.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 0x7f4dac1e80a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d800 tx=0x7f4d9c00dcc0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 shutdown_connections 2024-05-09T01:41:39.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d900762d0 0x7f4d900787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dac1570f0 0x7f4dac15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dac0c9500 0x7f4dac1e80a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 --2- 172.21.15.42:0/2750743575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dac0b7ba0 0x7f4dac14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:39.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 >> 172.21.15.42:0/2750743575 conn(0x7f4dac0d2100 msgr2=0x7f4dac06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:39.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 shutdown_connections 2024-05-09T01:41:39.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:39.993+0000 7f4db33ee640 1 -- 172.21.15.42:0/2750743575 wait complete. 2024-05-09T01:41:40.001 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T01:41:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.119+0000 7f353be9a640 1 Processor -- start 2024-05-09T01:41:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.119+0000 7f353be9a640 1 -- start start 2024-05-09T01:41:40.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353be9a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534072d80 0x7f3534154e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353be9a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3534071450 0x7f35340c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353be9a640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35340cba30 con 0x7f3534071860 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353be9a640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f3534070fc0 con 0x7f3534071450 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353be9a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f353415b590 con 0x7f3534072d80 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539435640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3534071450 0x7f35340c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353a437640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3534071860 0x7f353415e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60084/0 (socket says 172.21.15.42:60084) 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539435640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3534071450 0x7f35340c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34184/0 (socket says 172.21.15.42:34184) 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f353a437640 1 -- 172.21.15.42:0/1051716819 learned_addr learned my addr 172.21.15.42:0/1051716819 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539c36640 1 --2- 172.21.15.42:0/1051716819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534072d80 0x7f3534154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539435640 1 -- 172.21.15.42:0/1051716819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534072d80 msgr2=0x7f3534154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539435640 1 --2- 172.21.15.42:0/1051716819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534072d80 0x7f3534154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539435640 1 -- 172.21.15.42:0/1051716819 >> v1:172.21.15.42:6789/0 conn(0x7f3534071860 legacy=0x7f353415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3539435640 1 -- 172.21.15.42:0/1051716819 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353415b850 con 0x7f3534071450 2024-05-09T01:41:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.121+0000 7f3538c34640 1 -- 172.21.15.42:0/1051716819 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814715924 0 0) 0x7f35340cba30 con 0x7f3534071860 2024-05-09T01:41:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.122+0000 7f3539435640 1 --2- 172.21.15.42:0/1051716819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534071450 0x7f35340c5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3528009790 tx=0x7f352802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c176702107a0a379 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.122+0000 7f3538c34640 1 -- 172.21.15.42:0/1051716819 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528037070 con 0x7f3534071450 2024-05-09T01:41:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.122+0000 7f3538c34640 1 -- 172.21.15.42:0/1051716819 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3528032440 con 0x7f3534071450 2024-05-09T01:41:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.122+0000 7f3538c34640 1 -- 172.21.15.42:0/1051716819 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528032810 con 0x7f3534071450 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 -- 172.21.15.42:0/1051716819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534071450 msgr2=0x7f35340c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 --2- 172.21.15.42:0/1051716819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534071450 0x7f35340c5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3528009790 tx=0x7f352802a180 comp rx=0 tx=0).stop 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 -- 172.21.15.42:0/1051716819 shutdown_connections 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 --2- 172.21.15.42:0/1051716819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534071450 0x7f35340c5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 --2- 172.21.15.42:0/1051716819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534072d80 0x7f3534154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 -- 172.21.15.42:0/1051716819 >> 172.21.15.42:0/1051716819 conn(0x7f3534068c40 msgr2=0x7f3534072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 -- 172.21.15.42:0/1051716819 shutdown_connections 2024-05-09T01:41:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.123+0000 7f353be9a640 1 -- 172.21.15.42:0/1051716819 wait complete. 2024-05-09T01:41:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.125+0000 7f353be9a640 1 Processor -- start 2024-05-09T01:41:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.125+0000 7f353be9a640 1 -- start start 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353be9a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3534071450 0x7f353414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353be9a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534071860 0x7f35341f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353be9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 0x7f353415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353be9a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f35340cb6f0 con 0x7f3534072d80 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353be9a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f35340caea0 con 0x7f3534071450 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353be9a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f35340cbef0 con 0x7f3534071860 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353a437640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 0x7f353415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353a437640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 0x7f353415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34186/0 (socket says 172.21.15.42:34186) 2024-05-09T01:41:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f353a437640 1 -- 172.21.15.42:0/1168984036 learned_addr learned my addr 172.21.15.42:0/1168984036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f3539c36640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3534071450 0x7f353414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.126+0000 7f3539435640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534071860 0x7f35341f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353a437640 1 -- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534071860 msgr2=0x7f35341f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353a437640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534071860 0x7f35341f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353a437640 1 -- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3534071450 msgr2=0x7f353414b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353a437640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3534071450 0x7f353414b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353a437640 1 -- 172.21.15.42:0/1168984036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35341f5370 con 0x7f3534072d80 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f3539435640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534071860 0x7f35341f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353a437640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 0x7f353415a9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f352400c680 tx=0x7f352400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f35327fc640 1 -- 172.21.15.42:0/1168984036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524018070 con 0x7f3534072d80 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f35327fc640 1 -- 172.21.15.42:0/1168984036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524004d60 con 0x7f3534072d80 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353414e670 con 0x7f3534072d80 2024-05-09T01:41:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f35327fc640 1 -- 172.21.15.42:0/1168984036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352400a880 con 0x7f3534072d80 2024-05-09T01:41:40.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.127+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353414edb0 con 0x7f3534072d80 2024-05-09T01:41:40.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.130+0000 7f35327fc640 1 -- 172.21.15.42:0/1168984036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f352401b070 con 0x7f3534072d80 2024-05-09T01:41:40.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.130+0000 7f35327fc640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f35200762d0 0x7f35200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.130+0000 7f35327fc640 1 -- 172.21.15.42:0/1168984036 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3524096a70 con 0x7f3534072d80 2024-05-09T01:41:40.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.131+0000 7f3539c36640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f35200762d0 0x7f35200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.131+0000 7f3542e20740 1 Processor -- start 2024-05-09T01:41:40.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.131+0000 7f3542e20740 1 -- start start 2024-05-09T01:41:40.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.131+0000 7f3539c36640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f35200762d0 0x7f35200787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f352c009aa0 tx=0x7f352c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015ebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3542e20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015ec060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3542e20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de0150f4e0 con 0x55de011e6590 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55de014aaff0 con 0x55de01207270 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55de0150b4a0 con 0x55de011de3b0 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015ec060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34194/0 (socket says 172.21.15.42:34194) 2024-05-09T01:41:40.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 -- 172.21.15.42:0/2694608455 learned_addr learned my addr 172.21.15.42:0/2694608455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3539c36640 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f3539435640 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015ebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 -- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 msgr2=0x55de015ebb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015ebb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 -- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 msgr2=0x55de015ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.132+0000 7f353a437640 1 -- 172.21.15.42:0/2694608455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de01491720 con 0x55de011e6590 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.133+0000 7f353a437640 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015ec060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3524094fc0 tx=0x7f3524004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e938c7ebf8bb4f95 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.133+0000 7f351b7fe640 1 -- 172.21.15.42:0/2694608455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35240683f0 con 0x55de011e6590 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.133+0000 7f351b7fe640 1 -- 172.21.15.42:0/2694608455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524064080 con 0x55de011e6590 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.133+0000 7f351b7fe640 1 -- 172.21.15.42:0/2694608455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35240664b0 con 0x55de011e6590 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.133+0000 7f3542e20740 1 -- 172.21.15.42:0/2694608455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 msgr2=0x55de015ec060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.133+0000 7f3542e20740 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015ec060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3524094fc0 tx=0x7f3524004f90 comp rx=0 tx=0).stop 2024-05-09T01:41:40.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 -- 172.21.15.42:0/2694608455 shutdown_connections 2024-05-09T01:41:40.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015ec060 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015ebb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 --2- 172.21.15.42:0/2694608455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 -- 172.21.15.42:0/2694608455 >> 172.21.15.42:0/2694608455 conn(0x55de011fb3c0 msgr2=0x55de015ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 -- 172.21.15.42:0/2694608455 shutdown_connections 2024-05-09T01:41:40.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 -- 172.21.15.42:0/2694608455 wait complete. 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.134+0000 7f3542e20740 1 -- start start 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.135+0000 7f3542e20740 1 Processor -- start 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015e71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de01601a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015e6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de01496760 con 0x55de011e6590 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55de01604430 con 0x55de01207270 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55de015f13e0 con 0x55de011de3b0 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3542e20740 10 client.0 _ll_register_callbacks cb 0x55de014b94b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de01601a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de01601a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34196/0 (socket says 172.21.15.42:34196) 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 -- 172.21.15.42:0/539579294 learned_addr learned my addr 172.21.15.42:0/539579294 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539c36640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015e71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f353a437640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015e6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 -- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 msgr2=0x55de015e71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015e71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 -- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 msgr2=0x55de015e6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015e6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.136+0000 7f3539435640 1 -- 172.21.15.42:0/539579294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de014d7bd0 con 0x55de011e6590 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3539435640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de01601a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3528000c00 tx=0x7f3528004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3483e6c4ad655f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3518ff9640 1 -- 172.21.15.42:0/539579294 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528042030 con 0x55de011e6590 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3518ff9640 1 -- 172.21.15.42:0/539579294 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3528005990 con 0x55de011e6590 2024-05-09T01:41:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3524064080 con 0x55de011e6590 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3518ff9640 1 -- 172.21.15.42:0/539579294 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f352804d050 con 0x55de011e6590 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 10 client.4854 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55de014bd280 con 0x55de011e6590 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3518ff9640 1 -- 172.21.15.42:0/539579294 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524064080 con 0x55de011e6590 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3518ff9640 1 -- 172.21.15.42:0/539579294 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f3528050020 con 0x55de011e6590 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 10 client.4854 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 10 client.4854 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 20 client.4854 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de011c5e40 0x55de0160fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 4 client.4854 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.137+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 --> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de0151d0f0 con 0x55de011c5e40 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.138+0000 7f3539c36640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de011c5e40 0x55de0160fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.138+0000 7f3518ff9640 10 client.4854 ms_handle_connect on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.138+0000 7f3539c36640 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de011c5e40 0x55de0160fc40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed438f6927edf4dc server_cookie=68f05f40563afc62 in_seq=0 out_seq=0 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3518ff9640 1 -- 172.21.15.42:0/539579294 <== mds.2 v2:172.21.15.181:6838/2888840633 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55de0151d0f0 con 0x55de011c5e40 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3518ff9640 10 client.4854 handle_command_reply: tid=0 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 client.4854 shutdown 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 msgr2=0x55de01601a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de01601a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3528000c00 tx=0x7f3528004730 comp rx=0 tx=0).stop 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 shutdown_connections 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de011c5e40 0x55de0160fc40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de01207270 0x55de015e6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de01601a30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 --2- 172.21.15.42:0/539579294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011de3b0 0x55de015e71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 >> 172.21.15.42:0/539579294 conn(0x55de011fb3c0 msgr2=0x55de015d6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3518ff9640 0 client.4854 ms_handle_reset on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 shutdown_connections 2024-05-09T01:41:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 1 -- 172.21.15.42:0/539579294 wait complete. 2024-05-09T01:41:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.139+0000 7f3542e20740 20 client.4854 trim_cache size 0 max 16384 2024-05-09T01:41:40.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.158+0000 7f3542e20740 1 Processor -- start 2024-05-09T01:41:40.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.158+0000 7f3542e20740 1 -- start start 2024-05-09T01:41:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de015acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011e6590 0x55de015ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f3542e20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 0x55de015d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f3542e20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f35341f0f00 con 0x55de01207270 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55de01601510 con 0x55de011de3b0 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55de015ea8c0 con 0x55de011e6590 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.159+0000 7f353a437640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 0x55de015d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 0x55de015d56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34202/0 (socket says 172.21.15.42:34202) 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 -- 172.21.15.42:0/1533655629 learned_addr learned my addr 172.21.15.42:0/1533655629 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f3539c36640 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de015acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f3539435640 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011e6590 0x55de015ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 -- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011e6590 msgr2=0x55de015ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011e6590 0x55de015ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 -- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 msgr2=0x55de015acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de015acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 -- 172.21.15.42:0/1533655629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de01272850 con 0x55de01207270 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f353a437640 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 0x55de015d56c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f352400c650 tx=0x7f3524066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca46db08baabe34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f351affd640 1 -- 172.21.15.42:0/1533655629 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352407e070 con 0x55de01207270 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f351affd640 1 -- 172.21.15.42:0/1533655629 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524068aa0 con 0x55de01207270 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.160+0000 7f351affd640 1 -- 172.21.15.42:0/1533655629 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35240664f0 con 0x55de01207270 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 -- 172.21.15.42:0/1533655629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 msgr2=0x55de015d56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 0x55de015d56c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f352400c650 tx=0x7f3524066000 comp rx=0 tx=0).stop 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 -- 172.21.15.42:0/1533655629 shutdown_connections 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de01207270 0x55de015d56c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de011e6590 0x55de015ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 --2- 172.21.15.42:0/1533655629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de015acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 -- 172.21.15.42:0/1533655629 >> 172.21.15.42:0/1533655629 conn(0x55de011fb3c0 msgr2=0x55de015a26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 -- 172.21.15.42:0/1533655629 shutdown_connections 2024-05-09T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.161+0000 7f3542e20740 1 -- 172.21.15.42:0/1533655629 wait complete. 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.162+0000 7f3542e20740 1 -- start start 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.162+0000 7f3542e20740 1 Processor -- start 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de0166bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015e4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de01207270 0x55de015e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de015f1070 con 0x55de011e6590 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55de015f0a20 con 0x55de011de3b0 2024-05-09T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55de015aa7e0 con 0x55de01207270 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3542e20740 10 client.0 _ll_register_callbacks cb 0x7f3528035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3539435640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3539435640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015e4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34214/0 (socket says 172.21.15.42:34214) 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3539435640 1 -- 172.21.15.42:0/2380049342 learned_addr learned my addr 172.21.15.42:0/2380049342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.163+0000 7f3539c36640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de0166bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f353a437640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de01207270 0x55de015e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3539435640 1 -- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de01207270 msgr2=0x55de015e4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3539435640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de01207270 0x55de015e4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3539435640 1 -- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 msgr2=0x55de0166bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3539435640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de0166bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3539435640 1 -- 172.21.15.42:0/2380049342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de012e96b0 con 0x55de011e6590 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f353a437640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de01207270 0x55de015e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3539435640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015e4930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55de015ee6a0 tx=0x7f3528008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123c5c0a288c0d3f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3518ff9640 1 -- 172.21.15.42:0/2380049342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528042040 con 0x55de011e6590 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3518ff9640 1 -- 172.21.15.42:0/2380049342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3528003dd0 con 0x55de011e6590 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3524068aa0 con 0x55de011e6590 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3518ff9640 1 -- 172.21.15.42:0/2380049342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f3528059050 con 0x55de011e6590 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3542e20740 10 client.4860 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55de014cb630 con 0x55de011e6590 2024-05-09T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.164+0000 7f3518ff9640 1 -- 172.21.15.42:0/2380049342 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524068aa0 con 0x55de011e6590 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3518ff9640 1 -- 172.21.15.42:0/2380049342 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f352805c020 con 0x55de011e6590 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3542e20740 10 client.4860 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3542e20740 10 client.4860 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3542e20740 20 client.4860 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3542e20740 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de016722e0 0x55de0167acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3542e20740 4 client.4860 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 --> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] -- command(tid 0: {"prefix": "status"}) -- 0x55de01516f60 con 0x55de016722e0 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3539c36640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de016722e0 0x55de0167acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3518ff9640 10 client.4860 ms_handle_connect on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.165+0000 7f3539c36640 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de016722e0 0x55de0167acb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66137da4faef71a5 server_cookie=4b95ca2b7fc20734 in_seq=0 out_seq=0 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3518ff9640 1 -- 172.21.15.42:0/2380049342 <== mds.2 v2:172.21.15.181:6838/2888840633 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55de01516f60 con 0x55de016722e0 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3518ff9640 10 client.4860 handle_command_reply: tid=0 2024-05-09T01:41:40.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 client.4860 shutdown 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 msgr2=0x55de015e4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015e4930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55de015ee6a0 tx=0x7f3528008030 comp rx=0 tx=0).stop 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 shutdown_connections 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:6838/2888840633,v1:172.21.15.181:6839/2888840633] conn(0x55de016722e0 0x55de0167acb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55de01207270 0x55de015e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3518ff9640 0 client.4860 ms_handle_reset on v2:172.21.15.181:6838/2888840633 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de011e6590 0x55de015e4930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 --2- 172.21.15.42:0/2380049342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55de011de3b0 0x55de0166bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 >> 172.21.15.42:0/2380049342 conn(0x55de011fb3c0 msgr2=0x55de015a26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 shutdown_connections 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 1 -- 172.21.15.42:0/2380049342 wait complete. 2024-05-09T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f3542e20740 20 client.4860 trim_cache size 0 max 16384 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4253, 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 30.297616297000001, 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 46.441606061000002 2024-05-09T01:41:40.171 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.166+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f35200762d0 msgr2=0x7f35200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f35200762d0 0x7f35200787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f352c009aa0 tx=0x7f352c009190 comp rx=0 tx=0).stop 2024-05-09T01:41:40.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 msgr2=0x7f353415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 0x7f353415a9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f352400c680 tx=0x7f352400cb40 comp rx=0 tx=0).stop 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 shutdown_connections 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f35200762d0 0x7f35200787e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3534072d80 0x7f353415a9c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3534071860 0x7f35341f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 --2- 172.21.15.42:0/1168984036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3534071450 0x7f353414b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 >> 172.21.15.42:0/1168984036 conn(0x7f3534068c40 msgr2=0x7f3534150cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 shutdown_connections 2024-05-09T01:41:40.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.167+0000 7f353be9a640 1 -- 172.21.15.42:0/1168984036 wait complete. 2024-05-09T01:41:40.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-09T01:41:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.293+0000 7f8eb6261640 1 Processor -- start 2024-05-09T01:41:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.294+0000 7f8eb6261640 1 -- start start 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eb6261640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8eb006fa60 0x7f8eb0156f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eb6261640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006f230 0x7f8eb0167690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eb6261640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb0157450 con 0x7f8eb006ee20 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eb6261640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb0160f10 con 0x7f8eb006fa60 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eb6261640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb015dbd0 con 0x7f8eb006f230 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaf7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8eb006fa60 0x7f8eb0156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaeffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8eb006ee20 0x7f8eb00730d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60094/0 (socket says 172.21.15.42:60094) 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaeffd640 1 -- 172.21.15.42:0/2858389172 learned_addr learned my addr 172.21.15.42:0/2858389172 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaffff640 1 --2- 172.21.15.42:0/2858389172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006f230 0x7f8eb0167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2858389172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006f230 msgr2=0x7f8eb0167690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/2858389172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006f230 0x7f8eb0167690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2858389172 >> v1:172.21.15.42:6789/0 conn(0x7f8eb006ee20 legacy=0x7f8eb00730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2858389172 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb0160300 con 0x7f8eb006fa60 2024-05-09T01:41:40.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.295+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2858389172 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074687993 0 0) 0x7f8eb0157450 con 0x7f8eb006ee20 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.296+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/2858389172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0156f10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7224975ab8090ea2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.296+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2858389172 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0037070 con 0x7f8eb006fa60 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.296+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2858389172 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0032440 con 0x7f8eb006fa60 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.296+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2858389172 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0032810 con 0x7f8eb006fa60 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 -- 172.21.15.42:0/2858389172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 msgr2=0x7f8eb0156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 --2- 172.21.15.42:0/2858389172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0156f10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002a210 comp rx=0 tx=0).stop 2024-05-09T01:41:40.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 -- 172.21.15.42:0/2858389172 shutdown_connections 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 --2- 172.21.15.42:0/2858389172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006f230 0x7f8eb0167690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 --2- 172.21.15.42:0/2858389172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0156f10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 -- 172.21.15.42:0/2858389172 >> 172.21.15.42:0/2858389172 conn(0x7f8eb00cb190 msgr2=0x7f8eb00cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 -- 172.21.15.42:0/2858389172 shutdown_connections 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.297+0000 7f8eb6261640 1 -- 172.21.15.42:0/2858389172 wait complete. 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.299+0000 7f8eb6261640 1 Processor -- start 2024-05-09T01:41:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.299+0000 7f8eb6261640 1 -- start start 2024-05-09T01:41:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.300+0000 7f8eb6261640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006ee20 0x7f8eb015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.300+0000 7f8eb6261640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb006f230 0x7f8eb015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.300+0000 7f8eb6261640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.300+0000 7f8eb6261640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0160ba0 con 0x7f8eb006fa60 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.300+0000 7f8eb6261640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01608c0 con 0x7f8eb006f230 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.300+0000 7f8eb6261640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb006f640 con 0x7f8eb006ee20 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34242/0 (socket says 172.21.15.42:34242) 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 -- 172.21.15.42:0/4152748939 learned_addr learned my addr 172.21.15.42:0/4152748939 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006ee20 0x7f8eb015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb006f230 0x7f8eb015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 -- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006ee20 msgr2=0x7f8eb015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006ee20 0x7f8eb015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 -- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb006f230 msgr2=0x7f8eb015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb006f230 0x7f8eb015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 -- 172.21.15.42:0/4152748939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb015b9e0 con 0x7f8eb006fa60 2024-05-09T01:41:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006ee20 0x7f8eb015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eaffff640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0154370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8007d80 tx=0x7f8ea800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8e97fff640 1 -- 172.21.15.42:0/4152748939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8014420 con 0x7f8eb006fa60 2024-05-09T01:41:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8e97fff640 1 -- 172.21.15.42:0/4152748939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8019070 con 0x7f8eb006fa60 2024-05-09T01:41:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb015f0f0 con 0x7f8eb006fa60 2024-05-09T01:41:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8e97fff640 1 -- 172.21.15.42:0/4152748939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8014800 con 0x7f8eb006fa60 2024-05-09T01:41:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.301+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb015af80 con 0x7f8eb006fa60 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.303+0000 7f8e97fff640 1 -- 172.21.15.42:0/4152748939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ea80149a0 con 0x7f8eb006fa60 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.304+0000 7f8e97fff640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8e9c0762d0 0x7f8e9c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.304+0000 7f8e97fff640 1 -- 172.21.15.42:0/4152748939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ea8097dc0 con 0x7f8eb006fa60 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.304+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8e9c0762d0 0x7f8e9c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.304+0000 7f8ebd1ed740 1 Processor -- start 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.304+0000 7f8ebd1ed740 1 -- start start 2024-05-09T01:41:40.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.305+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8e9c0762d0 0x7f8e9c0787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0034000 tx=0x7f8ea002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fcb481d4e0 con 0x55fcb4515270 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fcb47b8ff0 con 0x55fcb44ec3b0 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fcb48194a0 con 0x55fcb44f4590 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34244/0 (socket says 172.21.15.42:34244) 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/3610372148 learned_addr learned my addr 172.21.15.42:0/3610372148 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaffff640 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 msgr2=0x55fcb48df7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48df7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 msgr2=0x55fcb48df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/3610372148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb479f720 con 0x55fcb4515270 2024-05-09T01:41:40.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.306+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48fbc80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8ea002a800 tx=0x7f8ea002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aafdf0b96387c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.307+0000 7f8e957fa640 1 -- 172.21.15.42:0/3610372148 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea004c070 con 0x55fcb4515270 2024-05-09T01:41:40.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.307+0000 7f8e957fa640 1 -- 172.21.15.42:0/3610372148 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0004230 con 0x55fcb4515270 2024-05-09T01:41:40.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.307+0000 7f8e957fa640 1 -- 172.21.15.42:0/3610372148 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0037040 con 0x55fcb4515270 2024-05-09T01:41:40.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.307+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/3610372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 msgr2=0x55fcb48fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.307+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48fbc80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8ea002a800 tx=0x7f8ea002c000 comp rx=0 tx=0).stop 2024-05-09T01:41:40.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/3610372148 shutdown_connections 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/3610372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48fbc80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/3610372148 >> 172.21.15.42:0/3610372148 conn(0x55fcb45093c0 msgr2=0x55fcb48b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/3610372148 shutdown_connections 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/3610372148 wait complete. 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.308+0000 7f8ebd1ed740 1 -- start start 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.309+0000 7f8ebd1ed740 1 Processor -- start 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48f6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 0x55fcb48f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb4515270 0x55fcb4902b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fcb48b9700 con 0x55fcb44f4590 2024-05-09T01:41:40.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fcb47a4760 con 0x55fcb44ec3b0 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fcb48f7110 con 0x55fcb4515270 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8ebd1ed740 10 client.0 _ll_register_callbacks cb 0x55fcb47c74b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 0x55fcb48f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 0x55fcb48f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34248/0 (socket says 172.21.15.42:34248) 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 -- 172.21.15.42:0/4008703906 learned_addr learned my addr 172.21.15.42:0/4008703906 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaffff640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb4515270 0x55fcb4902b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 -- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb4515270 msgr2=0x55fcb4902b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb4515270 0x55fcb4902b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 -- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 msgr2=0x55fcb48f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 -- 172.21.15.42:0/4008703906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb47e5bd0 con 0x55fcb44f4590 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 0x55fcb48f7d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005ee0 tx=0x7f8ea4001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179de9e8a258323b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.310+0000 7f8e8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/4008703906 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4001d20 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/4008703906 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ea40145e0 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea0004230 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/4008703906 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8ea4022050 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 10 client.4875 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55fcb47cb280 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/4008703906 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0004230 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/4008703906 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f8ea4025020 con 0x55fcb44f4590 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 10 client.4875 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 10 client.4875 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 20 client.4875 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb44d3e40 0x55fcb4919b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 4 client.4875 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:40.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 --> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcb482b0f0 con 0x55fcb44d3e40 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.311+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb44d3e40 0x55fcb4919b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8e8e7fc640 10 client.4875 ms_handle_connect on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb44d3e40 0x55fcb4919b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fba7b940924ba410 server_cookie=43b2b20e82c62fbb in_seq=0 out_seq=0 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/4008703906 <== mds.1 v2:172.21.15.42:6834/1138022510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fcb482b0f0 con 0x55fcb44d3e40 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8e8e7fc640 10 client.4875 handle_command_reply: tid=0 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8ebd1ed740 1 client.4875 shutdown 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 msgr2=0x55fcb48f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.312+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 0x55fcb48f7d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005ee0 tx=0x7f8ea4001520 comp rx=0 tx=0).stop 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 shutdown_connections 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb44d3e40 0x55fcb4919b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb4515270 0x55fcb4902b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8e8e7fc640 0 client.4875 ms_handle_reset on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:40.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44f4590 0x55fcb48f7d10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/4008703906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 >> 172.21.15.42:0/4008703906 conn(0x55fcb45093c0 msgr2=0x55fcb48b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 shutdown_connections 2024-05-09T01:41:40.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/4008703906 wait complete. 2024-05-09T01:41:40.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.313+0000 7f8ebd1ed740 20 client.4875 trim_cache size 0 max 16384 2024-05-09T01:41:40.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.333+0000 7f8ebd1ed740 1 Processor -- start 2024-05-09T01:41:40.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.333+0000 7f8ebd1ed740 1 -- start start 2024-05-09T01:41:40.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.334+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.334+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.334+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48f2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.334+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb00c9a30 con 0x55fcb4515270 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.334+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fcb48f6e50 con 0x55fcb44ec3b0 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.334+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fcb48f5c30 con 0x55fcb44f4590 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34264/0 (socket says 172.21.15.42:34264) 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 -- 172.21.15.42:0/2600177984 learned_addr learned my addr 172.21.15.42:0/2600177984 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 -- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 msgr2=0x55fcb48b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 -- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 msgr2=0x55fcb48b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 -- 172.21.15.42:0/2600177984 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb4580850 con 0x55fcb4515270 2024-05-09T01:41:40.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:41:40.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.335+0000 7f8eaffff640 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48f2360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ea805d6c0 tx=0x7f8ea801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4934763903e686 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.336+0000 7f8e94ff9640 1 -- 172.21.15.42:0/2600177984 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8069df0 con 0x55fcb4515270 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.336+0000 7f8e94ff9640 1 -- 172.21.15.42:0/2600177984 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8060330 con 0x55fcb4515270 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.336+0000 7f8e94ff9640 1 -- 172.21.15.42:0/2600177984 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea805ca40 con 0x55fcb4515270 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.337+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2600177984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 msgr2=0x55fcb48f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.337+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48f2360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ea805d6c0 tx=0x7f8ea801e000 comp rx=0 tx=0).stop 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2600177984 shutdown_connections 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb4515270 0x55fcb48f2360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2600177984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb44ec3b0 0x55fcb48b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2600177984 >> 172.21.15.42:0/2600177984 conn(0x55fcb45093c0 msgr2=0x55fcb48f5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2600177984 shutdown_connections 2024-05-09T01:41:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2600177984 wait complete. 2024-05-09T01:41:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.338+0000 7f8ebd1ed740 1 -- start start 2024-05-09T01:41:40.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.339+0000 7f8ebd1ed740 1 Processor -- start 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 0x55fcb49733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48e3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb4515270 0x55fcb48b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fcb48ff3b0 con 0x55fcb44ec3b0 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fcb48fed60 con 0x55fcb4515270 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fcb490e7d0 con 0x55fcb44f4590 2024-05-09T01:41:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8ebd1ed740 10 client.0 _ll_register_callbacks cb 0x7f8ea4007220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 0x55fcb49733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 0x55fcb49733b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34268/0 (socket says 172.21.15.42:34268) 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.340+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2285714069 learned_addr learned my addr 172.21.15.42:0/2285714069 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaffff640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb4515270 0x55fcb48b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 msgr2=0x55fcb48e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48e3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb4515270 msgr2=0x55fcb48b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb4515270 0x55fcb48b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaf7fe640 1 -- 172.21.15.42:0/2285714069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb45f76b0 con 0x55fcb44ec3b0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8eaf7fe640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 0x55fcb49733b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0032fd0 tx=0x7f8ea0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc7bcbe65558099 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8e8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.341+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/2285714069 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea005a030 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/2285714069 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8ea0004460 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea8060330 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/2285714069 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8ea0063050 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 10 client.4881 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55fcb47d9630 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/2285714069 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8060330 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/2285714069 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f8ea0066020 con 0x55fcb44ec3b0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 10 client.4881 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 10 client.4881 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 20 client.4881 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb48fdbf0 0x55fcb48f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 4 client.4881 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 --> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] -- command(tid 0: {"prefix": "status"}) -- 0x55fcb4824f60 con 0x55fcb48fdbf0 2024-05-09T01:41:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.342+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb48fdbf0 0x55fcb48f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8e8e7fc640 10 client.4881 ms_handle_connect on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8eaeffd640 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb48fdbf0 0x55fcb48f2c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d45257a582ae496 server_cookie=9f0eb069fe87ab56 in_seq=0 out_seq=0 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8e8e7fc640 1 -- 172.21.15.42:0/2285714069 <== mds.1 v2:172.21.15.42:6834/1138022510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55fcb4824f60 con 0x55fcb48fdbf0 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8e8e7fc640 10 client.4881 handle_command_reply: tid=0 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8ebd1ed740 1 client.4881 shutdown 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 msgr2=0x55fcb49733b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.343+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 0x55fcb49733b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0032fd0 tx=0x7f8ea0004730 comp rx=0 tx=0).stop 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 shutdown_connections 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcb4515270 0x55fcb48b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:6834/1138022510,v1:172.21.15.42:6835/1138022510] conn(0x55fcb48fdbf0 0x55fcb48f2c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fcb44f4590 0x55fcb48e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 --2- 172.21.15.42:0/2285714069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fcb44ec3b0 0x55fcb49733b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8e8e7fc640 0 client.4881 ms_handle_reset on v2:172.21.15.42:6834/1138022510 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 >> 172.21.15.42:0/2285714069 conn(0x55fcb45093c0 msgr2=0x55fcb48f9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 shutdown_connections 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 1 -- 172.21.15.42:0/2285714069 wait complete. 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8ebd1ed740 20 client.4881 trim_cache size 0 max 16384 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4287, 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 35.562194675000001, 2024-05-09T01:41:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 22, 2024-05-09T01:41:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 46.636204806999999 2024-05-09T01:41:40.346 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8e9c0762d0 msgr2=0x7f8e9c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8e9c0762d0 0x7f8e9c0787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0034000 tx=0x7f8ea002e000 comp rx=0 tx=0).stop 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 msgr2=0x7f8eb0154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0154370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8007d80 tx=0x7f8ea800e4b0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 shutdown_connections 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f8e9c0762d0 0x7f8e9c0787e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eb006fa60 0x7f8eb0154370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb006f230 0x7f8eb015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 --2- 172.21.15.42:0/4152748939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8eb006ee20 0x7f8eb015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.344+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 >> 172.21.15.42:0/4152748939 conn(0x7f8eb00cb190 msgr2=0x7f8eb0155230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.345+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 shutdown_connections 2024-05-09T01:41:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.345+0000 7f8eb6261640 1 -- 172.21.15.42:0/4152748939 wait complete. 2024-05-09T01:41:40.353 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-09T01:41:40.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.471+0000 7ff6a9013640 1 Processor -- start 2024-05-09T01:41:40.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.471+0000 7ff6a9013640 1 -- start start 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a9013640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a40717e0 0x7ff6a40c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a9013640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6a40cbef0 0x7ff6a40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a9013640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a406e320 con 0x7ff6a41602f0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a9013640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff6a4073500 con 0x7ff6a40cbef0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a9013640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a4070ab0 con 0x7ff6a40717e0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a359e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff6a41602f0 0x7ff6a4160700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60102/0 (socket says 172.21.15.42:60102) 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a359e640 1 -- 172.21.15.42:0/2061976990 learned_addr learned my addr 172.21.15.42:0/2061976990 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2061976990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a40717e0 0x7ff6a40c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2061976990 >> v2:172.21.15.181:3300/0 conn(0x7ff6a40cbef0 0x7ff6a40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a1d9b640 1 -- 172.21.15.42:0/2061976990 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971584342 0 0) 0x7ff6a406e320 con 0x7ff6a41602f0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a1d9b640 1 -- 172.21.15.42:0/2061976990 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff690003520 con 0x7ff6a41602f0 2024-05-09T01:41:40.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/2061976990 >> v2:172.21.15.181:3300/0 conn(0x7ff6a40cbef0 msgr2=0x7ff6a40caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2061976990 >> v2:172.21.15.181:3300/0 conn(0x7ff6a40cbef0 0x7ff6a40caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/2061976990 >> v1:172.21.15.42:6789/0 conn(0x7ff6a41602f0 legacy=0x7ff6a4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.473+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/2061976990 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a406e600 con 0x7ff6a40717e0 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.474+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2061976990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a40717e0 0x7ff6a40c6f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0097a0 tx=0x7ff69c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab80c15c764d88c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.474+0000 7ff6a1d9b640 1 -- 172.21.15.42:0/2061976990 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c037070 con 0x7ff6a40717e0 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.474+0000 7ff6a1d9b640 1 -- 172.21.15.42:0/2061976990 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69c032440 con 0x7ff6a40717e0 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.474+0000 7ff6a1d9b640 1 -- 172.21.15.42:0/2061976990 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0327f0 con 0x7ff6a40717e0 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 -- 172.21.15.42:0/2061976990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a40717e0 msgr2=0x7ff6a40c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2061976990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a40717e0 0x7ff6a40c6f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0097a0 tx=0x7ff69c02a210 comp rx=0 tx=0).stop 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 -- 172.21.15.42:0/2061976990 shutdown_connections 2024-05-09T01:41:40.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2061976990 >> v2:172.21.15.181:3300/0 conn(0x7ff6a40cbef0 0x7ff6a40caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2061976990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a40717e0 0x7ff6a40c6f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 -- 172.21.15.42:0/2061976990 >> 172.21.15.42:0/2061976990 conn(0x7ff6a4068c40 msgr2=0x7ff6a4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 -- 172.21.15.42:0/2061976990 shutdown_connections 2024-05-09T01:41:40.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.475+0000 7ff6a9013640 1 -- 172.21.15.42:0/2061976990 wait complete. 2024-05-09T01:41:40.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.477+0000 7ff6a9013640 1 Processor -- start 2024-05-09T01:41:40.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.477+0000 7ff6a9013640 1 -- start start 2024-05-09T01:41:40.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.478+0000 7ff6a9013640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40717e0 0x7ff6a41f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.478+0000 7ff6a9013640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 0x7ff6a4159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a9013640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a41602f0 0x7ff6a40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a9013640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a40712c0 con 0x7ff6a40cbef0 2024-05-09T01:41:40.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a9013640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4070fe0 con 0x7ff6a40717e0 2024-05-09T01:41:40.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a9013640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a40cc300 con 0x7ff6a41602f0 2024-05-09T01:41:40.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 0x7ff6a4159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 0x7ff6a4159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34282/0 (socket says 172.21.15.42:34282) 2024-05-09T01:41:40.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 -- 172.21.15.42:0/2859678534 learned_addr learned my addr 172.21.15.42:0/2859678534 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40717e0 0x7ff6a41f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a359e640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a41602f0 0x7ff6a40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 -- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a41602f0 msgr2=0x7ff6a40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a41602f0 0x7ff6a40c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 -- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40717e0 msgr2=0x7ff6a41f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40717e0 0x7ff6a41f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 -- 172.21.15.42:0/2859678534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a4158480 con 0x7ff6a40cbef0 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40717e0 0x7ff6a41f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 0x7ff6a4159260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e840 tx=0x7ff68c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff69b7fe640 1 -- 172.21.15.42:0/2859678534 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c017070 con 0x7ff6a40cbef0 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff69b7fe640 1 -- 172.21.15.42:0/2859678534 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c00c940 con 0x7ff6a40cbef0 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a41597a0 con 0x7ff6a40cbef0 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.479+0000 7ff69b7fe640 1 -- 172.21.15.42:0/2859678534 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00cd30 con 0x7ff6a40cbef0 2024-05-09T01:41:40.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.480+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a4158780 con 0x7ff6a40cbef0 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.482+0000 7ff69b7fe640 1 -- 172.21.15.42:0/2859678534 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff68c01a070 con 0x7ff6a40cbef0 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.482+0000 7ff69b7fe640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff684076300 0x7ff684078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.483+0000 7ff69b7fe640 1 -- 172.21.15.42:0/2859678534 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff68c097970 con 0x7ff6a40cbef0 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.483+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff684076300 0x7ff684078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.483+0000 7ff6aff9d740 1 Processor -- start 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.483+0000 7ff6aff9d740 1 -- start start 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.484+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff684076300 0x7ff684078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff69c034000 tx=0x7ff69c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.484+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d465bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.484+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d463f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d463f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5560d457d4e0 con 0x5560d4254590 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560d4518ff0 con 0x5560d4275270 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5560d45794a0 con 0x5560d424c3b0 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d463f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d463f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34286/0 (socket says 172.21.15.42:34286) 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 -- 172.21.15.42:0/2815920050 learned_addr learned my addr 172.21.15.42:0/2815920050 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d465bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d463f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 -- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 msgr2=0x5560d463f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d463f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 -- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 msgr2=0x5560d465bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d465bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 -- 172.21.15.42:0/2815920050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d44ff720 con 0x5560d4254590 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff6a359e640 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d463f7e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff694001f80 tx=0x7ff69400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edeef2950d382444 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff698ff9640 1 -- 172.21.15.42:0/2815920050 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694019070 con 0x5560d4254590 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff698ff9640 1 -- 172.21.15.42:0/2815920050 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69400ee50 con 0x5560d4254590 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.485+0000 7ff698ff9640 1 -- 172.21.15.42:0/2815920050 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694014680 con 0x5560d4254590 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2815920050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 msgr2=0x5560d463f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d463f7e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff694001f80 tx=0x7ff69400e530 comp rx=0 tx=0).stop 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2815920050 shutdown_connections 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d463f7e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d463f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2815920050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d465bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2815920050 >> 172.21.15.42:0/2815920050 conn(0x5560d42693c0 msgr2=0x5560d46198a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2815920050 shutdown_connections 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.486+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2815920050 wait complete. 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.487+0000 7ff6aff9d740 1 -- start start 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.487+0000 7ff6aff9d740 1 Processor -- start 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 0x5560d461b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4254590 0x5560d46560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d4275270 0x5560d4653510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5560d4619700 con 0x5560d424c3b0 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560d4504760 con 0x5560d4254590 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5560d4656ab0 con 0x5560d4275270 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 10 client.0 _ll_register_callbacks cb 0x5560d45274b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 0x5560d461b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 0x5560d461b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34298/0 (socket says 172.21.15.42:34298) 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/1263665735 learned_addr learned my addr 172.21.15.42:0/1263665735 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a259c640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4254590 0x5560d46560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a359e640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d4275270 0x5560d4653510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d4275270 msgr2=0x5560d4653510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d4275270 0x5560d4653510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4254590 msgr2=0x5560d46560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4254590 0x5560d46560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 -- 172.21.15.42:0/1263665735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560d4545bd0 con 0x5560d424c3b0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a359e640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d4275270 0x5560d4653510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 0x5560d461b2b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0098c0 tx=0x7ff69c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0c6de701d5bbb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff681ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff681ffb640 1 -- 172.21.15.42:0/1263665735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c04f060 con 0x5560d424c3b0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff681ffb640 1 -- 172.21.15.42:0/1263665735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff69c03d940 con 0x5560d424c3b0 2024-05-09T01:41:40.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.489+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff69400ee50 con 0x5560d424c3b0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff681ffb640 1 -- 172.21.15.42:0/1263665735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ff69c055050 con 0x5560d424c3b0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 10 client.4893 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5560d452b280 con 0x5560d424c3b0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff681ffb640 1 -- 172.21.15.42:0/1263665735 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69400ee50 con 0x5560d424c3b0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff681ffb640 1 -- 172.21.15.42:0/1263665735 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7ff69c058020 con 0x5560d424c3b0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 10 client.4893 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 10 client.4893 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 20 client.4893 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4233e40 0x5560d4679d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 4 client.4893 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560d458b0f0 con 0x5560d4233e40 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.490+0000 7ff6a259c640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4233e40 0x5560d4679d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.491+0000 7ff6a259c640 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4233e40 0x5560d4679d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a59bbd0e90e96df server_cookie=92917040ca7e17ad in_seq=0 out_seq=0 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.491+0000 7ff681ffb640 10 client.4893 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:40.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff681ffb640 1 -- 172.21.15.42:0/1263665735 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5560d458b0f0 con 0x5560d4233e40 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff681ffb640 10 client.4893 handle_command_reply: tid=0 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 client.4893 shutdown 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 msgr2=0x5560d461b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 0x5560d461b2b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0098c0 tx=0x7ff69c004730 comp rx=0 tx=0).stop 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 shutdown_connections 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4233e40 0x5560d4679d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d4275270 0x5560d4653510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4254590 0x5560d46560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff681ffb640 0 client.4893 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/1263665735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d424c3b0 0x5560d461b2b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 >> 172.21.15.42:0/1263665735 conn(0x5560d42693c0 msgr2=0x5560d46153a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 shutdown_connections 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 1 -- 172.21.15.42:0/1263665735 wait complete. 2024-05-09T01:41:40.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.492+0000 7ff6aff9d740 20 client.4893 trim_cache size 0 max 16384 2024-05-09T01:41:40.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.511+0000 7ff6aff9d740 1 Processor -- start 2024-05-09T01:41:40.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.511+0000 7ff6aff9d740 1 -- start start 2024-05-09T01:41:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d461a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d461a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4618610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41f65d0 con 0x5560d4254590 2024-05-09T01:41:40.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560d4642b90 con 0x5560d4275270 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5560d46568e0 con 0x5560d424c3b0 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d461a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d461a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34314/0 (socket says 172.21.15.42:34314) 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.512+0000 7ff6a259c640 1 -- 172.21.15.42:0/2760472666 learned_addr learned my addr 172.21.15.42:0/2760472666 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a259c640 1 -- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 msgr2=0x5560d461a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d461a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a359e640 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4618610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d461a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a259c640 1 -- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 msgr2=0x5560d4618610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4618610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a259c640 1 -- 172.21.15.42:0/2760472666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d42e0850 con 0x5560d4254590 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a359e640 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4618610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff6a259c640 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d461a930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0608e0 tx=0x7ff68c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4353bcc64fcf2ee4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff683fff640 1 -- 172.21.15.42:0/2760472666 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c021040 con 0x5560d4254590 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff683fff640 1 -- 172.21.15.42:0/2760472666 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c0612e0 con 0x5560d4254590 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.513+0000 7ff683fff640 1 -- 172.21.15.42:0/2760472666 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c060be0 con 0x5560d4254590 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2760472666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 msgr2=0x5560d461a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d461a930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0608e0 tx=0x7ff68c01e040 comp rx=0 tx=0).stop 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2760472666 shutdown_connections 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4618610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d461a930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/2760472666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d461a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2760472666 >> 172.21.15.42:0/2760472666 conn(0x5560d42693c0 msgr2=0x5560d4668840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2760472666 shutdown_connections 2024-05-09T01:41:40.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 -- 172.21.15.42:0/2760472666 wait complete. 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.514+0000 7ff6aff9d740 1 -- start start 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.515+0000 7ff6aff9d740 1 Processor -- start 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d46d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d46dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4651190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5560d4641fc0 con 0x5560d4254590 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560d4655ad0 con 0x5560d4275270 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5560d466e800 con 0x5560d424c3b0 2024-05-09T01:41:40.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6aff9d740 10 client.0 _ll_register_callbacks cb 0x7ff69c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d46dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d46dbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34324/0 (socket says 172.21.15.42:34324) 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 -- 172.21.15.42:0/4159023817 learned_addr learned my addr 172.21.15.42:0/4159023817 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 -- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 msgr2=0x5560d46d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a359e640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4651190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d46d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d46d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 -- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 msgr2=0x5560d4651190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4651190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 -- 172.21.15.42:0/4159023817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560d43576b0 con 0x5560d4254590 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a359e640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4651190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d46d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff6a259c640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d46dbe50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c520 tx=0x7ff69c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39bb8863a7341de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff681ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.516+0000 7ff681ffb640 1 -- 172.21.15.42:0/4159023817 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c06e020 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff681ffb640 1 -- 172.21.15.42:0/4159023817 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff68c060040 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff68c0612e0 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff681ffb640 1 -- 172.21.15.42:0/4159023817 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ff68c021040 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 10 client.4899 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5560d4539630 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff681ffb640 1 -- 172.21.15.42:0/4159023817 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c0612e0 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff681ffb640 1 -- 172.21.15.42:0/4159023817 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7ff68c067190 con 0x5560d4254590 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 10 client.4899 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 10 client.4899 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 20 client.4899 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4642d10 0x5560d4643120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 4 client.4899 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:41:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "status"}) -- 0x5560d4584f60 con 0x5560d4642d10 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.517+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4642d10 0x5560d4643120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff681ffb640 10 client.4899 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6a2d9d640 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4642d10 0x5560d4643120 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d859f6451309ed5b server_cookie=946d161a39da56f4 in_seq=0 out_seq=0 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff681ffb640 1 -- 172.21.15.42:0/4159023817 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x5560d4584f60 con 0x5560d4642d10 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff681ffb640 10 client.4899 handle_command_reply: tid=0 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 client.4899 shutdown 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 msgr2=0x5560d46dbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d46dbe50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c520 tx=0x7ff69c02c000 comp rx=0 tx=0).stop 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 shutdown_connections 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5560d4642d10 0x5560d4643120 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560d4275270 0x5560d4651190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560d4254590 0x5560d46dbe50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 --2- 172.21.15.42:0/4159023817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5560d424c3b0 0x5560d46d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff681ffb640 0 client.4899 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 >> 172.21.15.42:0/4159023817 conn(0x5560d42693c0 msgr2=0x5560d4653420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 shutdown_connections 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 1 -- 172.21.15.42:0/4159023817 wait complete. 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.518+0000 7ff6aff9d740 20 client.4899 trim_cache size 0 max 16384 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f3e448d1-28fc-4e6e-85c6-4e5031602bbf", 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-05-09T01:41:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4311, 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 40.783497984, 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 16, 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 22, 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 46.79507452 2024-05-09T01:41:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff684076300 msgr2=0x7ff684078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff684076300 0x7ff684078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff69c034000 tx=0x7ff69c02e000 comp rx=0 tx=0).stop 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 msgr2=0x7ff6a4159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 0x7ff6a4159260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e840 tx=0x7ff68c00ed00 comp rx=0 tx=0).stop 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 shutdown_connections 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff684076300 0x7ff684078810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6a41602f0 0x7ff6a40c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6a40cbef0 0x7ff6a4159260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 --2- 172.21.15.42:0/2859678534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40717e0 0x7ff6a41f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 >> 172.21.15.42:0/2859678534 conn(0x7ff6a4068c40 msgr2=0x7ff6a40cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 shutdown_connections 2024-05-09T01:41:40.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:40.519+0000 7ff6a9013640 1 -- 172.21.15.42:0/2859678534 wait complete. 2024-05-09T01:41:40.527 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-09T01:41:55.529 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-09T01:41:55.529 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.95 2024-05-09T01:41:55.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:41:55.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.662+0000 7f18c69e3640 1 Processor -- start 2024-05-09T01:41:55.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.662+0000 7f18c69e3640 1 -- start start 2024-05-09T01:41:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.663+0000 7f18c69e3640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f18c00b7ba0 0x7f18c00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.663+0000 7f18c69e3640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f18c01570f0 0x7f18c00ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.663+0000 7f18c69e3640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c0160420 con 0x7f18c00c9500 2024-05-09T01:41:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.663+0000 7f18c69e3640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f18c01612f0 con 0x7f18c00b7ba0 2024-05-09T01:41:55.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.663+0000 7f18c69e3640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00cc350 con 0x7f18c01570f0 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f18c00b7ba0 0x7f18c00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f18c00b7ba0 0x7f18c00ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59232/0 (socket says 172.21.15.42:59232) 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 -- 172.21.15.42:0/1335775731 learned_addr learned my addr 172.21.15.42:0/1335775731 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18c4f80640 1 --2- 172.21.15.42:0/1335775731 >> v2:172.21.15.181:3300/0 conn(0x7f18c01570f0 0x7f18c00ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 -- 172.21.15.42:0/1335775731 >> v2:172.21.15.181:3300/0 conn(0x7f18c01570f0 msgr2=0x7f18c00ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 --2- 172.21.15.42:0/1335775731 >> v2:172.21.15.181:3300/0 conn(0x7f18c01570f0 0x7f18c00ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 -- 172.21.15.42:0/1335775731 >> v1:172.21.15.181:6789/0 conn(0x7f18c00c9500 legacy=0x7f18c00c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:55.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.664+0000 7f18b7fff640 1 -- 172.21.15.42:0/1335775731 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c01606e0 con 0x7f18c00b7ba0 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.665+0000 7f18b7fff640 1 --2- 172.21.15.42:0/1335775731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00b7ba0 0x7f18c00ce4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18c0074e50 tx=0x7f18a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edb0a458192e9e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.665+0000 7f18bf7fe640 1 -- 172.21.15.42:0/1335775731 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8037070 con 0x7f18c00b7ba0 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.665+0000 7f18bf7fe640 1 -- 172.21.15.42:0/1335775731 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a8032440 con 0x7f18c00b7ba0 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.665+0000 7f18bf7fe640 1 -- 172.21.15.42:0/1335775731 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8032810 con 0x7f18c00b7ba0 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 -- 172.21.15.42:0/1335775731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00b7ba0 msgr2=0x7f18c00ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 --2- 172.21.15.42:0/1335775731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00b7ba0 0x7f18c00ce4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18c0074e50 tx=0x7f18a802a1e0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 -- 172.21.15.42:0/1335775731 shutdown_connections 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 --2- 172.21.15.42:0/1335775731 >> v2:172.21.15.181:3300/0 conn(0x7f18c01570f0 0x7f18c00ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 --2- 172.21.15.42:0/1335775731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00b7ba0 0x7f18c00ce4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 -- 172.21.15.42:0/1335775731 >> 172.21.15.42:0/1335775731 conn(0x7f18c00d2100 msgr2=0x7f18c00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:55.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 -- 172.21.15.42:0/1335775731 shutdown_connections 2024-05-09T01:41:55.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.666+0000 7f18c69e3640 1 -- 172.21.15.42:0/1335775731 wait complete. 2024-05-09T01:41:55.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.667+0000 7f18c69e3640 1 Processor -- start 2024-05-09T01:41:55.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.667+0000 7f18c69e3640 1 -- start start 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c69e3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c00b7ba0 0x7f18c0151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c69e3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 0x7f18c015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c69e3640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c01570f0 0x7f18c014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c69e3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0160f80 con 0x7f18c00c9500 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c69e3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0160ca0 con 0x7f18c00b7ba0 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c69e3640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f18c0157500 con 0x7f18c01570f0 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 0x7f18c015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 0x7f18c015f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59236/0 (socket says 172.21.15.42:59236) 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 -- 172.21.15.42:0/2295507769 learned_addr learned my addr 172.21.15.42:0/2295507769 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18bffff640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c00b7ba0 0x7f18c0151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c4f80640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c01570f0 0x7f18c014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:55.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 -- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c01570f0 msgr2=0x7f18c014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c01570f0 0x7f18c014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 -- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c00b7ba0 msgr2=0x7f18c0151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c00b7ba0 0x7f18c0151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 -- 172.21.15.42:0/2295507769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0152140 con 0x7f18c00c9500 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18c4f80640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c01570f0 0x7f18c014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18b7fff640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 0x7f18c015f5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f18a802a220 tx=0x7f18a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.669+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8041020 con 0x7f18c00c9500 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.670+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a80306c0 con 0x7f18c00c9500 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.670+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c006dd40 con 0x7f18c00c9500 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.670+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8037040 con 0x7f18c00c9500 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.670+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c0150e40 con 0x7f18c00c9500 2024-05-09T01:41:55.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.670+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c00cbf50 con 0x7f18c00c9500 2024-05-09T01:41:55.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.671+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18a8044020 con 0x7f18c00c9500 2024-05-09T01:41:55.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.672+0000 7f18bd7fa640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f18a0076300 0x7f18a0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:55.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.672+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f18a80b7e40 con 0x7f18c00c9500 2024-05-09T01:41:55.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.672+0000 7f18bffff640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f18a0076300 0x7f18a0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:55.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.673+0000 7f18bffff640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f18a0076300 0x7f18a0078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18b0006fd0 tx=0x7f18b0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.677+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18a804b030 con 0x7f18c00c9500 2024-05-09T01:41:55.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.907+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18c00c65b0 con 0x7f18c00c9500 2024-05-09T01:41:55.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.907+0000 7f18bd7fa640 1 -- 172.21.15.42:0/2295507769 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f18a8081720 con 0x7f18c00c9500 2024-05-09T01:41:55.905 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:41:55.905 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:41:55.905 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f18a0076300 msgr2=0x7f18a0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f18a0076300 0x7f18a0078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18b0006fd0 tx=0x7f18b0009060 comp rx=0 tx=0).stop 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 msgr2=0x7f18c015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 0x7f18c015f5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f18a802a220 tx=0x7f18a80046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 shutdown_connections 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f18a0076300 0x7f18a0078810 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c01570f0 0x7f18c014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c00c9500 0x7f18c015f5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 --2- 172.21.15.42:0/2295507769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c00b7ba0 0x7f18c0151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 >> 172.21.15.42:0/2295507769 conn(0x7f18c00d2100 msgr2=0x7f18c006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:55.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 shutdown_connections 2024-05-09T01:41:55.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:55.909+0000 7f18c69e3640 1 -- 172.21.15.42:0/2295507769 wait complete. 2024-05-09T01:41:55.918 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db / --timeout 90 --expiration 144.95 --await-for 45.0' 2024-05-09T01:41:55.918 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db / --timeout 90 --expiration 144.95 --await-for 45.0 2024-05-09T01:41:56.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.046+0000 7f62f2d1f640 1 Processor -- start 2024-05-09T01:41:56.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.046+0000 7f62f2d1f640 1 -- start start 2024-05-09T01:41:56.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f2d1f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62ec0cb110 0x7f62ec15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f2d1f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62ec154e80 0x7f62ec0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f2d1f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f2d1f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f62ec15ec60 con 0x7f62ec154e80 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f2d1f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f62ec0cb9e0 con 0x7f62ec0cb110 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f2d1f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec0cb5e0 con 0x7f62ec0cd4c0 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62ebfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62ec154e80 0x7f62ec0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62ebfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62ec154e80 0x7f62ec0ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59238/0 (socket says 172.21.15.42:59238) 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62ebfff640 1 -- 172.21.15.42:0/3672528993 learned_addr learned my addr 172.21.15.42:0/3672528993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f0abb640 1 --2- 172.21.15.42:0/3672528993 >> v2:172.21.15.181:3300/0 conn(0x7f62ec0cb110 0x7f62ec15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.047+0000 7f62f12bc640 1 --2- 172.21.15.42:0/3672528993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.048+0000 7f62ebfff640 1 -- 172.21.15.42:0/3672528993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 msgr2=0x7f62ec0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.048+0000 7f62ebfff640 1 --2- 172.21.15.42:0/3672528993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.048+0000 7f62ebfff640 1 -- 172.21.15.42:0/3672528993 >> v2:172.21.15.181:3300/0 conn(0x7f62ec0cb110 msgr2=0x7f62ec15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.048+0000 7f62ebfff640 1 --2- 172.21.15.42:0/3672528993 >> v2:172.21.15.181:3300/0 conn(0x7f62ec0cb110 0x7f62ec15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.048+0000 7f62ebfff640 1 -- 172.21.15.42:0/3672528993 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec15e050 con 0x7f62ec154e80 2024-05-09T01:41:56.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.048+0000 7f62ebfff640 1 --2- 172.21.15.42:0/3672528993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec0ccf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0cb0a0 tx=0x7f62dc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2a8f22098ed8c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62eb7fe640 1 -- 172.21.15.42:0/3672528993 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc036070 con 0x7f62ec154e80 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62eb7fe640 1 -- 172.21.15.42:0/3672528993 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc031600 con 0x7f62ec154e80 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62eb7fe640 1 -- 172.21.15.42:0/3672528993 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0319d0 con 0x7f62ec154e80 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 -- 172.21.15.42:0/3672528993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 msgr2=0x7f62ec0ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/3672528993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec0ccf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0cb0a0 tx=0x7f62dc02a730 comp rx=0 tx=0).stop 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 -- 172.21.15.42:0/3672528993 shutdown_connections 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/3672528993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/3672528993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec0ccf80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/3672528993 >> v2:172.21.15.181:3300/0 conn(0x7f62ec0cb110 0x7f62ec15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 -- 172.21.15.42:0/3672528993 >> 172.21.15.42:0/3672528993 conn(0x7f62ec068a30 msgr2=0x7f62ec068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 -- 172.21.15.42:0/3672528993 shutdown_connections 2024-05-09T01:41:56.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.049+0000 7f62f2d1f640 1 -- 172.21.15.42:0/3672528993 wait complete. 2024-05-09T01:41:56.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.051+0000 7f62f2d1f640 1 Processor -- start 2024-05-09T01:41:56.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.051+0000 7f62f2d1f640 1 -- start start 2024-05-09T01:41:56.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62ec0cb110 0x7f62ec14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec15e8f0 con 0x7f62ec154e80 2024-05-09T01:41:56.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec15e610 con 0x7f62ec0cb110 2024-05-09T01:41:56.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec0cc660 con 0x7f62ec0cd4c0 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec1536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59250/0 (socket says 172.21.15.42:59250) 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 -- 172.21.15.42:0/2332610807 learned_addr learned my addr 172.21.15.42:0/2332610807 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62ec0cb110 0x7f62ec14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62ebfff640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 -- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 msgr2=0x7f62ec151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 -- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62ec0cb110 msgr2=0x7f62ec14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62ec0cb110 0x7f62ec14e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 -- 172.21.15.42:0/2332610807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec14cb50 con 0x7f62ec154e80 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f12bc640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec1536c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62d400e7c0 tx=0x7f62d400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62e97fa640 1 -- 172.21.15.42:0/2332610807 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4017070 con 0x7f62ec154e80 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62e97fa640 1 -- 172.21.15.42:0/2332610807 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d400c730 con 0x7f62ec154e80 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62e97fa640 1 -- 172.21.15.42:0/2332610807 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d400cb20 con 0x7f62ec154e80 2024-05-09T01:41:56.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec14d6a0 con 0x7f62ec154e80 2024-05-09T01:41:56.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.053+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec14dc60 con 0x7f62ec154e80 2024-05-09T01:41:56.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.055+0000 7f62e97fa640 1 -- 172.21.15.42:0/2332610807 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f62d401a070 con 0x7f62ec154e80 2024-05-09T01:41:56.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.056+0000 7f62e97fa640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f62cc0762d0 0x7f62cc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.056+0000 7f62e97fa640 1 -- 172.21.15.42:0/2332610807 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f62d4097820 con 0x7f62ec154e80 2024-05-09T01:41:56.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.056+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f62cc0762d0 0x7f62cc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.056+0000 7f62f9bd5740 1 Processor -- start 2024-05-09T01:41:56.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.057+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f62cc0762d0 0x7f62cc0787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009a20 tx=0x7f62e4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.057+0000 7f62f9bd5740 1 -- start start 2024-05-09T01:41:56.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02a147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 0x55fd02a38f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fd02978960 con 0x55fd0264fc90 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fd02931b70 con 0x55fd02647ab0 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fd02974920 con 0x55fd02670970 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 0x55fd02a38f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 0x55fd02a38f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59252/0 (socket says 172.21.15.42:59252) 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 -- 172.21.15.42:0/1693925627 learned_addr learned my addr 172.21.15.42:0/1693925627 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f0abb640 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02a147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62ebfff640 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 -- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 msgr2=0x55fd02a147b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02a147b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 -- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 msgr2=0x55fd02a539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 -- 172.21.15.42:0/1693925627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd026dbf50 con 0x55fd0264fc90 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f0abb640 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02a147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62f12bc640 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 0x55fd02a38f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f62d405d000 tx=0x7f62d4060520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a0c758067e0c76 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.058+0000 7f62e27fc640 1 -- 172.21.15.42:0/1693925627 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4021070 con 0x55fd0264fc90 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62e27fc640 1 -- 172.21.15.42:0/1693925627 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4069070 con 0x55fd0264fc90 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62e27fc640 1 -- 172.21.15.42:0/1693925627 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4064d10 con 0x55fd0264fc90 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 -- 172.21.15.42:0/1693925627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 msgr2=0x55fd02a38f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 0x55fd02a38f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f62d405d000 tx=0x7f62d4060520 comp rx=0 tx=0).stop 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 -- 172.21.15.42:0/1693925627 shutdown_connections 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd0264fc90 0x55fd02a38f20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/1693925627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02a147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 -- 172.21.15.42:0/1693925627 >> 172.21.15.42:0/1693925627 conn(0x55fd02664ac0 msgr2=0x55fd02a136b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:56.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 -- 172.21.15.42:0/1693925627 shutdown_connections 2024-05-09T01:41:56.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.059+0000 7f62f9bd5740 1 -- 172.21.15.42:0/1693925627 wait complete. 2024-05-09T01:41:56.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.060+0000 7f62f9bd5740 1 -- start start 2024-05-09T01:41:56.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.060+0000 7f62f9bd5740 1 Processor -- start 2024-05-09T01:41:56.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a0e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a58a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 0x55fd02a4ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fd028ff490 con 0x55fd02670970 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fd02a59470 con 0x55fd02647ab0 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fd02a64820 con 0x55fd0264fc90 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f9bd5740 10 client.0 _ll_register_callbacks cb 0x55fd028fb5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 0x55fd02a4ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 0x55fd02a4ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59266/0 (socket says 172.21.15.42:59266) 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 -- 172.21.15.42:0/4073653462 learned_addr learned my addr 172.21.15.42:0/4073653462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f0abb640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a0e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62ebfff640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a58a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 -- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 msgr2=0x55fd02a58a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a58a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 -- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 msgr2=0x55fd02a0e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a0e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 -- 172.21.15.42:0/4073653462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd02752db0 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62f12bc640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 0x55fd02a4ec50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62d40609a0 tx=0x7f62d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7298e39b5cedc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.062+0000 7f62cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62cb7fe640 1 -- 172.21.15.42:0/4073653462 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d405fe70 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62cb7fe640 1 -- 172.21.15.42:0/4073653462 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f62d405c380 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd029863b0 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62cb7fe640 1 -- 172.21.15.42:0/4073653462 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f62d4064d10 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 10 client.4917 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55fd02a65310 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62cb7fe640 1 -- 172.21.15.42:0/4073653462 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fd029863b0 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62cb7fe640 1 -- 172.21.15.42:0/4073653462 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f62d405c580 con 0x55fd02670970 2024-05-09T01:41:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 10 client.4917 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 10 client.4917 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 20 client.4917 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd0262f750 0x55fd02a5bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 4 client.4917 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd029803e0 con 0x55fd0262f750 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.063+0000 7f62f0abb640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd0262f750 0x55fd02a5bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.064+0000 7f62f0abb640 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd0262f750 0x55fd02a5bf40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b4449d6f3b2637 server_cookie=9aecb46468bdfd02 in_seq=0 out_seq=0 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.064+0000 7f62cb7fe640 10 client.4917 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62cb7fe640 1 -- 172.21.15.42:0/4073653462 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd029803e0 con 0x55fd0262f750 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62cb7fe640 10 client.4917 handle_command_reply: tid=0 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 client.4917 shutdown 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 msgr2=0x55fd02a4ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 0x55fd02a4ec50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62d40609a0 tx=0x7f62d40046c0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 shutdown_connections 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd0262f750 0x55fd02a5bf40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02670970 0x55fd02a4ec50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62cb7fe640 0 client.4917 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a58a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/4073653462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02647ab0 0x55fd02a0e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 >> 172.21.15.42:0/4073653462 conn(0x55fd02664ac0 msgr2=0x55fd02a121d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 shutdown_connections 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 1 -- 172.21.15.42:0/4073653462 wait complete. 2024-05-09T01:41:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.065+0000 7f62f9bd5740 20 client.4917 trim_cache size 0 max 16384 2024-05-09T01:41:56.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.083+0000 7f62f9bd5740 1 Processor -- start 2024-05-09T01:41:56.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.083+0000 7f62f9bd5740 1 -- start start 2024-05-09T01:41:56.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a0f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a12080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02670970 0x55fd02a125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1fe680 con 0x55fd02647ab0 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec14aeb0 con 0x55fd02670970 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec1fdfb0 con 0x55fd0264fc90 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.084+0000 7f62f0abb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a0f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a0f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59274/0 (socket says 172.21.15.42:59274) 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 -- 172.21.15.42:0/2859036710 learned_addr learned my addr 172.21.15.42:0/2859036710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f12bc640 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02670970 0x55fd02a125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 -- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 msgr2=0x55fd02a12080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a12080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 -- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02670970 msgr2=0x55fd02a125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02670970 0x55fd02a125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 -- 172.21.15.42:0/2859036710 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd02a58b70 con 0x55fd02647ab0 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f12bc640 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02670970 0x55fd02a125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:56.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a0f2c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f62e4011690 tx=0x7f62e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a990818cf61354e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62e1ffb640 1 -- 172.21.15.42:0/2859036710 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4011cd0 con 0x55fd02647ab0 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62e1ffb640 1 -- 172.21.15.42:0/2859036710 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4011e70 con 0x55fd02647ab0 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.085+0000 7f62e1ffb640 1 -- 172.21.15.42:0/2859036710 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4003c90 con 0x55fd02647ab0 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2859036710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 msgr2=0x55fd02a0f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a0f2c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f62e4011690 tx=0x7f62e4018000 comp rx=0 tx=0).stop 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2859036710 shutdown_connections 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd02670970 0x55fd02a125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd0264fc90 0x55fd02a12080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2859036710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a0f2c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2859036710 >> 172.21.15.42:0/2859036710 conn(0x55fd02664ac0 msgr2=0x55fd02a4e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2859036710 shutdown_connections 2024-05-09T01:41:56.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.086+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2859036710 wait complete. 2024-05-09T01:41:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.087+0000 7f62f9bd5740 1 -- start start 2024-05-09T01:41:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.087+0000 7f62f9bd5740 1 Processor -- start 2024-05-09T01:41:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a5aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd0264fc90 0x55fd02acbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02acc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1fd8e0 con 0x55fd02647ab0 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1fd210 con 0x55fd0264fc90 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec1f5240 con 0x55fd02670970 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f9bd5740 10 client.0 _ll_register_callbacks cb 0x7f62d4060180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f0abb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a5aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f0abb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a5aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59286/0 (socket says 172.21.15.42:59286) 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.088+0000 7f62f0abb640 1 -- 172.21.15.42:0/2443279166 learned_addr learned my addr 172.21.15.42:0/2443279166 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62ebfff640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd0264fc90 0x55fd02acbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f12bc640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02acc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f0abb640 1 -- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 msgr2=0x55fd02acc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02acc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f0abb640 1 -- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd0264fc90 msgr2=0x55fd02acbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd0264fc90 0x55fd02acbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f0abb640 1 -- 172.21.15.42:0/2443279166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd02a550b0 con 0x55fd02647ab0 2024-05-09T01:41:56.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62ebfff640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd0264fc90 0x55fd02acbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f0abb640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a5aca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009800 tx=0x7f62e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c16436983035b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62cb7fe640 1 -- 172.21.15.42:0/2443279166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e403a020 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62cb7fe640 1 -- 172.21.15.42:0/2443279166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f62e4005da0 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e4011e70 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62cb7fe640 1 -- 172.21.15.42:0/2443279166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f62e4011cd0 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f9bd5740 10 client.4923 fetch_fsmap learned FSMap version 16 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55fd02a59fd0 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.089+0000 7f62cb7fe640 1 -- 172.21.15.42:0/2443279166 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4011e70 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62cb7fe640 1 -- 172.21.15.42:0/2443279166 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f62e4047080 con 0x55fd02647ab0 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62f9bd5740 10 client.4923 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62f9bd5740 10 client.4923 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62f9bd5740 20 client.4923 populate_metadata read hostname 'smithi042' 2024-05-09T01:41:56.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd02a54190 0x55fd02a545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:41:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62f9bd5740 4 client.4923 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.95, "await_for": 45.0}] 2024-05-09T01:41:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.95, "await_for": 45.0}) -- 0x55fd027eff40 con 0x55fd02a54190 2024-05-09T01:41:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62ebfff640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd02a54190 0x55fd02a545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:41:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62cb7fe640 10 client.4923 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:56.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.090+0000 7f62ebfff640 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd02a54190 0x55fd02a545a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead2d21cc27914be server_cookie=8742a31132b72c33 in_seq=0 out_seq=0 2024-05-09T01:41:56.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62cb7fe640 1 -- 172.21.15.42:0/2443279166 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55fd027eff40 con 0x55fd02a54190 2024-05-09T01:41:56.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62cb7fe640 10 client.4923 handle_command_reply: tid=0 2024-05-09T01:41:56.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 client.4923 shutdown 2024-05-09T01:41:56.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 msgr2=0x55fd02a5aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a5aca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009800 tx=0x7f62e4004730 comp rx=0 tx=0).stop 2024-05-09T01:41:56.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 shutdown_connections 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55fd02a54190 0x55fd02a545a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fd02670970 0x55fd02acc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd0264fc90 0x55fd02acbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62cb7fe640 0 client.4923 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 --2- 172.21.15.42:0/2443279166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fd02647ab0 0x55fd02a5aca0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 >> 172.21.15.42:0/2443279166 conn(0x55fd02664ac0 msgr2=0x55fd02a3dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 shutdown_connections 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 1 -- 172.21.15.42:0/2443279166 wait complete. 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.094+0000 7f62f9bd5740 20 client.4923 trim_cache size 0 max 16384 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:41:56.093 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 2, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "6d4a4174": { 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 2, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 144.9, 2024-05-09T01:41:56.094 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:41:56.095 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f62cc0762d0 msgr2=0x7f62cc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f62cc0762d0 0x7f62cc0787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009a20 tx=0x7f62e4009190 comp rx=0 tx=0).stop 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 msgr2=0x7f62ec1536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec1536c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62d400e7c0 tx=0x7f62d400ec80 comp rx=0 tx=0).stop 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 shutdown_connections 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f62cc0762d0 0x7f62cc0787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62ec154e80 0x7f62ec1536c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62ec0cd4c0 0x7f62ec151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 --2- 172.21.15.42:0/2332610807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62ec0cb110 0x7f62ec14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:41:56.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 >> 172.21.15.42:0/2332610807 conn(0x7f62ec068a30 msgr2=0x7f62ec0c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:41:56.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 shutdown_connections 2024-05-09T01:41:56.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:41:56.095+0000 7f62f2d1f640 1 -- 172.21.15.42:0/2332610807 wait complete. 2024-05-09T01:41:56.103 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6d4a4174', quiesce took 0.6 seconds. Will release after: 24.349999999999998 2024-05-09T01:42:01.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:42:01.354 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:42:20.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:42:20.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.589+0000 7fcdd8492640 1 Processor -- start 2024-05-09T01:42:20.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.589+0000 7fcdd8492640 1 -- start start 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.590+0000 7fcdd8492640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 0x7fcdd00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.590+0000 7fcdd8492640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd0070600 0x7fcdd00c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.590+0000 7fcdd8492640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd00c5330 con 0x7fcdd0074910 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.590+0000 7fcdd8492640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd0072cf0 con 0x7fcdd00c7a10 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.590+0000 7fcdd8492640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd00c8730 con 0x7fcdd0070600 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd5a2d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 0x7fcdd00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd6a2f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd0070600 0x7fcdd00c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd5a2d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 0x7fcdd00700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:35184/0 (socket says 172.21.15.42:35184) 2024-05-09T01:42:20.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd5a2d640 1 -- 172.21.15.42:0/2370571795 learned_addr learned my addr 172.21.15.42:0/2370571795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd6a2f640 1 -- 172.21.15.42:0/2370571795 >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 msgr2=0x7fcdd00700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd6a2f640 1 --2- 172.21.15.42:0/2370571795 >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 0x7fcdd00700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd6a2f640 1 -- 172.21.15.42:0/2370571795 >> v1:172.21.15.181:6789/0 conn(0x7fcdd0074910 legacy=0x7fcdd0153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd522c640 1 -- 172.21.15.42:0/2370571795 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178359976 0 0) 0x7fcdd00c5330 con 0x7fcdd0074910 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd6a2f640 1 -- 172.21.15.42:0/2370571795 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd0074d20 con 0x7fcdd0070600 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.591+0000 7fcdd5a2d640 1 --2- 172.21.15.42:0/2370571795 >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 0x7fcdd00700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.592+0000 7fcdd6a2f640 1 --2- 172.21.15.42:0/2370571795 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd0070600 0x7fcdd00c8bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009d90 tx=0x7fcdc802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df747035ad17874f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.592+0000 7fcdd522c640 1 -- 172.21.15.42:0/2370571795 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8007740 con 0x7fcdd0070600 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.592+0000 7fcdd522c640 1 -- 172.21.15.42:0/2370571795 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc80078e0 con 0x7fcdd0070600 2024-05-09T01:42:20.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.592+0000 7fcdd522c640 1 -- 172.21.15.42:0/2370571795 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8007cb0 con 0x7fcdd0070600 2024-05-09T01:42:20.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 -- 172.21.15.42:0/2370571795 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd0070600 msgr2=0x7fcdd00c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 --2- 172.21.15.42:0/2370571795 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd0070600 0x7fcdd00c8bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009d90 tx=0x7fcdc802a660 comp rx=0 tx=0).stop 2024-05-09T01:42:20.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 -- 172.21.15.42:0/2370571795 shutdown_connections 2024-05-09T01:42:20.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 --2- 172.21.15.42:0/2370571795 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd0070600 0x7fcdd00c8bc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 --2- 172.21.15.42:0/2370571795 >> v2:172.21.15.181:3300/0 conn(0x7fcdd00c7a10 0x7fcdd00700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 -- 172.21.15.42:0/2370571795 >> 172.21.15.42:0/2370571795 conn(0x7fcdd006cdc0 msgr2=0x7fcdd00cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:20.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 -- 172.21.15.42:0/2370571795 shutdown_connections 2024-05-09T01:42:20.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.593+0000 7fcdd8492640 1 -- 172.21.15.42:0/2370571795 wait complete. 2024-05-09T01:42:20.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.595+0000 7fcdd8492640 1 Processor -- start 2024-05-09T01:42:20.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.595+0000 7fcdd8492640 1 -- start start 2024-05-09T01:42:20.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd8492640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 0x7fcdd00ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd8492640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdd0074910 0x7fcdd01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd8492640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd00c7a10 0x7fcdd01567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd8492640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00c9fd0 con 0x7fcdd0070600 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd8492640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00c58d0 con 0x7fcdd0074910 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd8492640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd00ca2b0 con 0x7fcdd00c7a10 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd622e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 0x7fcdd00ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd622e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 0x7fcdd00ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33452/0 (socket says 172.21.15.42:33452) 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd622e640 1 -- 172.21.15.42:0/1245511493 learned_addr learned my addr 172.21.15.42:0/1245511493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd5a2d640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdd0074910 0x7fcdd01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.596+0000 7fcdd6a2f640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd00c7a10 0x7fcdd01567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd622e640 1 -- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd00c7a10 msgr2=0x7fcdd01567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd622e640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd00c7a10 0x7fcdd01567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd622e640 1 -- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdd0074910 msgr2=0x7fcdd01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd622e640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdd0074910 0x7fcdd01548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd622e640 1 -- 172.21.15.42:0/1245511493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd00cd440 con 0x7fcdd0070600 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd622e640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 0x7fcdd00ccf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c3c0 tx=0x7fcdcc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc017070 con 0x7fcdd0070600 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc0035f0 con 0x7fcdd0070600 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd01f1630 con 0x7fcdd0070600 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc003a20 con 0x7fcdd0070600 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.597+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd00ce300 con 0x7fcdd0070600 2024-05-09T01:42:20.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.598+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd0153560 con 0x7fcdd0070600 2024-05-09T01:42:20.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.599+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcdcc01a070 con 0x7fcdd0070600 2024-05-09T01:42:20.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.599+0000 7fcdc6ffd640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdb4076300 0x7fcdb4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.600+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fcdcc0969a0 con 0x7fcdd0070600 2024-05-09T01:42:20.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.600+0000 7fcdd5a2d640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdb4076300 0x7fcdb4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.600+0000 7fcdd5a2d640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdb4076300 0x7fcdb4078810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009630 tx=0x7fcdc0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.604+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcdcc05fba0 con 0x7fcdd0070600 2024-05-09T01:42:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.833+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdd0076260 con 0x7fcdd0070600 2024-05-09T01:42:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.834+0000 7fcdc6ffd640 1 -- 172.21.15.42:0/1245511493 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7fcdcc063ea0 con 0x7fcdd0070600 2024-05-09T01:42:20.831 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:42:20.831 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:42:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:42:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdb4076300 msgr2=0x7fcdb4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdb4076300 0x7fcdb4078810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009630 tx=0x7fcdc0009240 comp rx=0 tx=0).stop 2024-05-09T01:42:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 msgr2=0x7fcdd00ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 0x7fcdd00ccf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c3c0 tx=0x7fcdcc00c880 comp rx=0 tx=0).stop 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 shutdown_connections 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fcdb4076300 0x7fcdb4078810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcdd00c7a10 0x7fcdd01567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdd0074910 0x7fcdd01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 --2- 172.21.15.42:0/1245511493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd0070600 0x7fcdd00ccf00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 >> 172.21.15.42:0/1245511493 conn(0x7fcdd006cdc0 msgr2=0x7fcdd00c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 shutdown_connections 2024-05-09T01:42:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.836+0000 7fcdd8492640 1 -- 172.21.15.42:0/1245511493 wait complete. 2024-05-09T01:42:20.844 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db --set-id 6d4a4174 --release --await' 2024-05-09T01:42:20.845 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db --set-id 6d4a4174 --release --await 2024-05-09T01:42:20.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.970+0000 7f6e35269640 1 Processor -- start 2024-05-09T01:42:20.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.970+0000 7f6e35269640 1 -- start start 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e35269640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 0x7f6e300c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e35269640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6e300caaf0 0x7f6e30160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e35269640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3006e320 con 0x7f6e300cbef0 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e35269640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6e30073500 con 0x7f6e300caaf0 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e35269640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e30070ab0 con 0x7f6e300717e0 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e267fc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6e300cbef0 0x7f6e301602f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43704/0 (socket says 172.21.15.42:43704) 2024-05-09T01:42:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.971+0000 7f6e267fc640 1 -- 172.21.15.42:0/614686135 learned_addr learned my addr 172.21.15.42:0/614686135 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2effd640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 0x7f6e300c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/614686135 >> v2:172.21.15.181:3300/0 conn(0x7f6e300caaf0 0x7f6e30160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623977560 0 0) 0x7f6e3006e320 con 0x7f6e300cbef0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e1c003520 con 0x7f6e300cbef0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 862937093 0 0) 0x7f6e1c003520 con 0x7f6e300cbef0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 msgr2=0x7f6e300c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 0x7f6e300c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 >> v2:172.21.15.181:3300/0 conn(0x7f6e300caaf0 msgr2=0x7f6e30160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 --2- 172.21.15.42:0/614686135 >> v2:172.21.15.181:3300/0 conn(0x7f6e300caaf0 0x7f6e30160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3006e600 con 0x7f6e300cbef0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f6e18001870 con 0x7f6e300cbef0 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 >> v1:172.21.15.42:6789/0 conn(0x7f6e300cbef0 legacy=0x7f6e301602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e1c003a00 0x7f6e1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c004800 0x7f6e1c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 0x7f6e1c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30070ab0 con 0x7f6e1c003a00 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c00ba70 con 0x7f6e1c004800 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c00bc70 con 0x7f6e300717e0 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2effd640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e1c003a00 0x7f6e1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e267fc640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c004800 0x7f6e1c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.972+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 0x7f6e1c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.973+0000 7f6e2effd640 1 -- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 msgr2=0x7f6e1c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.973+0000 7f6e2effd640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e300717e0 0x7f6e1c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.973+0000 7f6e2effd640 1 -- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c004800 msgr2=0x7f6e1c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.973+0000 7f6e2effd640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c004800 0x7f6e1c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.973+0000 7f6e2effd640 1 -- 172.21.15.42:0/614686135 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c003520 con 0x7f6e1c003a00 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.973+0000 7f6e2effd640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e1c003a00 0x7f6e1c003e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009ac0 tx=0x7f6e1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c624b4358ed6d3b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20036070 con 0x7f6e1c003a00 2024-05-09T01:42:20.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e20031400 con 0x7f6e1c003a00 2024-05-09T01:42:20.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e2e7fc640 1 -- 172.21.15.42:0/614686135 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20009690 con 0x7f6e1c003a00 2024-05-09T01:42:20.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e35269640 1 -- 172.21.15.42:0/614686135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e1c003a00 msgr2=0x7f6e1c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e35269640 1 --2- 172.21.15.42:0/614686135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e1c003a00 0x7f6e1c003e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009ac0 tx=0x7f6e1c005830 comp rx=0 tx=0).stop 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e2f7fe640 1 -- 172.21.15.42:0/614686135 reap_dead start 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e35269640 1 -- 172.21.15.42:0/614686135 shutdown_connections 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e35269640 1 -- 172.21.15.42:0/614686135 >> 172.21.15.42:0/614686135 conn(0x7f6e30068c40 msgr2=0x7f6e30072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e35269640 1 -- 172.21.15.42:0/614686135 shutdown_connections 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.974+0000 7f6e35269640 1 -- 172.21.15.42:0/614686135 wait complete. 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.976+0000 7f6e35269640 1 Processor -- start 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.976+0000 7f6e35269640 1 -- start start 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.977+0000 7f6e35269640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c003a00 0x7f6e300b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.977+0000 7f6e35269640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e301f6970 0x7f6e300cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e35269640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 0x7f6e301f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e35269640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e300712c0 con 0x7f6e301f3380 2024-05-09T01:42:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e35269640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30070fe0 con 0x7f6e1c003a00 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e35269640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e300cc300 con 0x7f6e301f6970 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 0x7f6e301f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 0x7f6e301f3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33466/0 (socket says 172.21.15.42:33466) 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 -- 172.21.15.42:0/2759616975 learned_addr learned my addr 172.21.15.42:0/2759616975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2effd640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c003a00 0x7f6e300b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e267fc640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e301f6970 0x7f6e300cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 -- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e301f6970 msgr2=0x7f6e300cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e301f6970 0x7f6e300cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 -- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c003a00 msgr2=0x7f6e300b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c003a00 0x7f6e300b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 -- 172.21.15.42:0/2759616975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e301f4870 con 0x7f6e301f3380 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e267fc640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e301f6970 0x7f6e300cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:42:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 0x7f6e301f3790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c5430 tx=0x7f6e2800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e27fff640 1 -- 172.21.15.42:0/2759616975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800fe10 con 0x7f6e301f3380 2024-05-09T01:42:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e27fff640 1 -- 172.21.15.42:0/2759616975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28015430 con 0x7f6e301f3380 2024-05-09T01:42:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e300b53c0 con 0x7f6e301f3380 2024-05-09T01:42:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.978+0000 7f6e27fff640 1 -- 172.21.15.42:0/2759616975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28015820 con 0x7f6e301f3380 2024-05-09T01:42:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.979+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e300b43a0 con 0x7f6e301f3380 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.981+0000 7f6e27fff640 1 -- 172.21.15.42:0/2759616975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e280159c0 con 0x7f6e301f3380 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.981+0000 7f6e27fff640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6e100762d0 0x7f6e100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.981+0000 7f6e27fff640 1 -- 172.21.15.42:0/2759616975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6e28098490 con 0x7f6e301f3380 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.982+0000 7f6e2effd640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6e100762d0 0x7f6e100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.982+0000 7f6e3c1f4740 1 Processor -- start 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.982+0000 7f6e2effd640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6e100762d0 0x7f6e100787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009ac0 tx=0x7f6e20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.982+0000 7f6e3c1f4740 1 -- start start 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.983+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594e48c0 0x5574598c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.983+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.983+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594c3be0 0x5574598ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.983+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5574597ec890 con 0x5574594bba00 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.983+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557459788620 con 0x5574594e48c0 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.983+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5574597e8850 con 0x5574594c3be0 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33482/0 (socket says 172.21.15.42:33482) 2024-05-09T01:42:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 -- 172.21.15.42:0/205265921 learned_addr learned my addr 172.21.15.42:0/205265921 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e2effd640 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594e48c0 0x5574598c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594c3be0 0x5574598ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 -- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594c3be0 msgr2=0x5574598ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594c3be0 0x5574598ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 -- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594e48c0 msgr2=0x5574598c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594e48c0 0x5574598c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 -- 172.21.15.42:0/205265921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574597b3a70 con 0x5574594bba00 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e267fc640 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598acef0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e18007db0 tx=0x7f6e18001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8972f28b8d86763 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e24ff9640 1 -- 172.21.15.42:0/205265921 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18019070 con 0x5574594bba00 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e24ff9640 1 -- 172.21.15.42:0/205265921 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e180057a0 con 0x5574594bba00 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.984+0000 7f6e24ff9640 1 -- 172.21.15.42:0/205265921 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18005b50 con 0x5574594bba00 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/205265921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 msgr2=0x5574598acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598acef0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e18007db0 tx=0x7f6e18001900 comp rx=0 tx=0).stop 2024-05-09T01:42:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/205265921 shutdown_connections 2024-05-09T01:42:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594c3be0 0x5574598ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598acef0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/205265921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594e48c0 0x5574598c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/205265921 >> 172.21.15.42:0/205265921 conn(0x5574594d8a10 msgr2=0x5574598874f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/205265921 shutdown_connections 2024-05-09T01:42:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.985+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/205265921 wait complete. 2024-05-09T01:42:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.986+0000 7f6e3c1f4740 1 -- start start 2024-05-09T01:42:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.986+0000 7f6e3c1f4740 1 Processor -- start 2024-05-09T01:42:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594c3be0 0x5574598ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557459887350 con 0x5574594bba00 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557459774330 con 0x5574594c3be0 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5574598acee0 con 0x5574594e48c0 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 10 client.0 _ll_register_callbacks cb 0x55745976fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33490/0 (socket says 172.21.15.42:33490) 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 -- 172.21.15.42:0/3949723459 learned_addr learned my addr 172.21.15.42:0/3949723459 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594c3be0 0x5574598ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 -- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 msgr2=0x5574598c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 -- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594c3be0 msgr2=0x5574598ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594c3be0 0x5574598ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 -- 172.21.15.42:0/3949723459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55745954fea0 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594c3be0 0x5574598ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e2effd640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598ac4d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6e20004330 tx=0x7f6e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d284be30c836b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e0dffb640 1 -- 172.21.15.42:0/3949723459 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20040040 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e0dffb640 1 -- 172.21.15.42:0/3949723459 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6e20003d10 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.988+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e180057a0 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e0dffb640 1 -- 172.21.15.42:0/3949723459 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6e20036040 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 10 client.4938 fetch_fsmap learned FSMap version 16 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5574595c6d00 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e0dffb640 1 -- 172.21.15.42:0/3949723459 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e180057a0 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e0dffb640 1 -- 172.21.15.42:0/3949723459 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f6e2005a080 con 0x5574594bba00 2024-05-09T01:42:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 10 client.4938 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 10 client.4938 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 20 client.4938 populate_metadata read hostname 'smithi042' 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5574594a3490 0x5574598c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 4 client.4938 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574597fa2e0 con 0x5574594a3490 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.989+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5574594a3490 0x5574598c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.990+0000 7f6e0dffb640 10 client.4938 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.990+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5574594a3490 0x5574598c4fa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07e7debbf02ec73 server_cookie=fddb1de201a51fdb in_seq=0 out_seq=0 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.990+0000 7f6e0dffb640 1 -- 172.21.15.42:0/3949723459 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5574597fa2e0 con 0x5574594a3490 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.990+0000 7f6e0dffb640 10 client.4938 handle_command_reply: tid=0 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.990+0000 7f6e3c1f4740 1 client.4938 shutdown 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 msgr2=0x5574598ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598ac4d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6e20004330 tx=0x7f6e200046c0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 shutdown_connections 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x5574594a3490 0x5574598c4fa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e0dffb640 0 client.4938 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594c3be0 0x5574598ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3949723459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594bba00 0x5574598ac4d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 >> 172.21.15.42:0/3949723459 conn(0x5574594d8a10 msgr2=0x5574598c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 shutdown_connections 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3949723459 wait complete. 2024-05-09T01:42:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:20.991+0000 7f6e3c1f4740 20 client.4938 trim_cache size 0 max 16384 2024-05-09T01:42:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.009+0000 7f6e3c1f4740 1 Processor -- start 2024-05-09T01:42:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.009+0000 7f6e3c1f4740 1 -- start start 2024-05-09T01:42:21.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x557459889970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598dace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30200d20 con 0x5574594c3be0 2024-05-09T01:42:21.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e301ff1e0 con 0x5574594bba00 2024-05-09T01:42:21.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e30200650 con 0x5574594e48c0 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33504/0 (socket says 172.21.15.42:33504) 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 -- 172.21.15.42:0/3713624062 learned_addr learned my addr 172.21.15.42:0/3713624062 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 -- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 msgr2=0x5574598dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 -- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 msgr2=0x557459889970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e2effd640 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x557459889970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x557459889970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 -- 172.21.15.42:0/3713624062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574598ca110 con 0x5574594c3be0 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e2effd640 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x557459889970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.010+0000 7f6e267fc640 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598da7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000c00 tx=0x7f6e18010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3455e2a493ce6a08 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e0ffff640 1 -- 172.21.15.42:0/3713624062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18029070 con 0x5574594c3be0 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e0ffff640 1 -- 172.21.15.42:0/3713624062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18005db0 con 0x5574594c3be0 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e0ffff640 1 -- 172.21.15.42:0/3713624062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18019040 con 0x5574594c3be0 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3713624062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 msgr2=0x5574598da7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598da7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000c00 tx=0x7f6e18010000 comp rx=0 tx=0).stop 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3713624062 shutdown_connections 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x5574598dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598da7a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/3713624062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x557459889970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3713624062 >> 172.21.15.42:0/3713624062 conn(0x5574594d8a10 msgr2=0x55745987e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3713624062 shutdown_connections 2024-05-09T01:42:21.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.011+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/3713624062 wait complete. 2024-05-09T01:42:21.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.012+0000 7f6e3c1f4740 1 -- start start 2024-05-09T01:42:21.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.012+0000 7f6e3c1f4740 1 Processor -- start 2024-05-09T01:42:21.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.013+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x5574598a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.013+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.013+0000 7f6e3c1f4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x55745993a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.013+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e301fff80 con 0x5574594c3be0 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.013+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e301ff8b0 con 0x5574594bba00 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.013+0000 7f6e3c1f4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e300b30b0 con 0x5574594e48c0 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e3c1f4740 10 client.0 _ll_register_callbacks cb 0x7f6e1c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33516/0 (socket says 172.21.15.42:33516) 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 -- 172.21.15.42:0/1804652715 learned_addr learned my addr 172.21.15.42:0/1804652715 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e2f7fe640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x55745993a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e2effd640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x5574598a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 -- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 msgr2=0x55745993a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x55745993a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 -- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 msgr2=0x5574598a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x5574598a37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 -- 172.21.15.42:0/1804652715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574598ec2c0 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e267fc640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598c20c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000ef0 tx=0x7f6e3006f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7097534bff4cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e0dffb640 1 -- 172.21.15.42:0/1804652715 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18031070 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e0dffb640 1 -- 172.21.15.42:0/1804652715 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6e18005b90 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e18005db0 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e0dffb640 1 -- 172.21.15.42:0/1804652715 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6e1803c050 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e3c1f4740 10 client.4944 fetch_fsmap learned FSMap version 16 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.014+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5574598acc80 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e0dffb640 1 -- 172.21.15.42:0/1804652715 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18005db0 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e0dffb640 1 -- 172.21.15.42:0/1804652715 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f6e1803f020 con 0x5574594c3be0 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e3c1f4740 10 client.4944 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:42:21.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e3c1f4740 10 client.4944 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e3c1f4740 20 client.4944 populate_metadata read hostname 'smithi042' 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55745993aa30 0x5574598a6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e3c1f4740 4 client.4944 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6d4a4174", "release": true, "await": true}] 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6d4a4174", "release": true, "await": true}) -- 0x5574597f4310 con 0x55745993aa30 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e2effd640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55745993aa30 0x5574598a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e0dffb640 10 client.4944 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.015+0000 7f6e2effd640 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55745993aa30 0x5574598a6480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecaecb475c901e15 server_cookie=c9ee6f8ee205cbf5 in_seq=0 out_seq=0 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e0dffb640 1 -- 172.21.15.42:0/1804652715 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5574597f4310 con 0x55745993aa30 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e0dffb640 10 client.4944 handle_command_reply: tid=0 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 client.4944 shutdown 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 msgr2=0x5574598c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598c20c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000ef0 tx=0x7f6e3006f630 comp rx=0 tx=0).stop 2024-05-09T01:42:21.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 shutdown_connections 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55745993aa30 0x5574598a6480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5574594e48c0 0x55745993a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e0dffb640 0 client.4944 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5574594c3be0 0x5574598c20c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 --2- 172.21.15.42:0/1804652715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574594bba00 0x5574598a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 >> 172.21.15.42:0/1804652715 conn(0x5574594d8a10 msgr2=0x5574598ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 shutdown_connections 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 1 -- 172.21.15.42:0/1804652715 wait complete. 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.017+0000 7f6e3c1f4740 20 client.4944 trim_cache size 0 max 16384 2024-05-09T01:42:21.019 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 4, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "6d4a4174": { 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 4, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-05-09T01:42:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 144.9, 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.021 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:42:21.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6e100762d0 msgr2=0x7f6e100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6e100762d0 0x7f6e100787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009ac0 tx=0x7f6e20008030 comp rx=0 tx=0).stop 2024-05-09T01:42:21.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 msgr2=0x7f6e301f3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 0x7f6e301f3790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c5430 tx=0x7f6e2800f580 comp rx=0 tx=0).stop 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 shutdown_connections 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6e100762d0 0x7f6e100787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e301f3380 0x7f6e301f3790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e301f6970 0x7f6e300cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 --2- 172.21.15.42:0/2759616975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e1c003a00 0x7f6e300b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 >> 172.21.15.42:0/2759616975 conn(0x7f6e30068c40 msgr2=0x7f6e30075d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 shutdown_connections 2024-05-09T01:42:21.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.018+0000 7f6e35269640 1 -- 172.21.15.42:0/2759616975 wait complete. 2024-05-09T01:42:21.027 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6d4a4174', total seconds elapsed: 25.5 2024-05-09T01:42:21.027 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.95 2024-05-09T01:42:21.027 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:42:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.145+0000 7f0e60184640 1 Processor -- start 2024-05-09T01:42:21.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.145+0000 7f0e60184640 1 -- start start 2024-05-09T01:42:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e60184640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0e580c9500 0x7f0e580ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e60184640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e580b7ba0 0x7f0e581570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e60184640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e58160420 con 0x7f0e580c9a80 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e60184640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0e581612f0 con 0x7f0e580b7ba0 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e60184640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0e580cc350 con 0x7f0e580c9500 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e580b7ba0 0x7f0e581570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e580b7ba0 0x7f0e581570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33522/0 (socket says 172.21.15.42:33522) 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 -- 172.21.15.42:0/4206061217 learned_addr learned my addr 172.21.15.42:0/4206061217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5df20640 1 --2- 172.21.15.42:0/4206061217 >> v2:172.21.15.181:3300/0 conn(0x7f0e580c9500 0x7f0e580ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 -- 172.21.15.42:0/4206061217 >> v2:172.21.15.181:3300/0 conn(0x7f0e580c9500 msgr2=0x7f0e580ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 --2- 172.21.15.42:0/4206061217 >> v2:172.21.15.181:3300/0 conn(0x7f0e580c9500 0x7f0e580ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 -- 172.21.15.42:0/4206061217 >> v1:172.21.15.181:6789/0 conn(0x7f0e580c9a80 legacy=0x7f0e580ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5d71f640 1 -- 172.21.15.42:0/4206061217 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e581606e0 con 0x7f0e580b7ba0 2024-05-09T01:42:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.147+0000 7f0e5df20640 1 --2- 172.21.15.42:0/4206061217 >> v2:172.21.15.181:3300/0 conn(0x7f0e580c9500 0x7f0e580ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.148+0000 7f0e5d71f640 1 --2- 172.21.15.42:0/4206061217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580b7ba0 0x7f0e581570f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0e580ccf50 tx=0x7f0e4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dcc2c43181c09 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.148+0000 7f0e5cf1e640 1 -- 172.21.15.42:0/4206061217 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c037070 con 0x7f0e580b7ba0 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.148+0000 7f0e5cf1e640 1 -- 172.21.15.42:0/4206061217 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c032440 con 0x7f0e580b7ba0 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.148+0000 7f0e5cf1e640 1 -- 172.21.15.42:0/4206061217 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c032810 con 0x7f0e580b7ba0 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 -- 172.21.15.42:0/4206061217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580b7ba0 msgr2=0x7f0e581570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 --2- 172.21.15.42:0/4206061217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580b7ba0 0x7f0e581570f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0e580ccf50 tx=0x7f0e4c02a270 comp rx=0 tx=0).stop 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 -- 172.21.15.42:0/4206061217 shutdown_connections 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 --2- 172.21.15.42:0/4206061217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580b7ba0 0x7f0e581570f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 --2- 172.21.15.42:0/4206061217 >> v2:172.21.15.181:3300/0 conn(0x7f0e580c9500 0x7f0e580ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 -- 172.21.15.42:0/4206061217 >> 172.21.15.42:0/4206061217 conn(0x7f0e580d2100 msgr2=0x7f0e580d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 -- 172.21.15.42:0/4206061217 shutdown_connections 2024-05-09T01:42:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.149+0000 7f0e60184640 1 -- 172.21.15.42:0/4206061217 wait complete. 2024-05-09T01:42:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.151+0000 7f0e60184640 1 Processor -- start 2024-05-09T01:42:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.151+0000 7f0e60184640 1 -- start start 2024-05-09T01:42:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e60184640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e580b7ba0 0x7f0e580d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e60184640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 0x7f0e581e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e60184640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e580c9a80 0x7f0e581542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e60184640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58160f80 con 0x7f0e580c9500 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e60184640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58160ca0 con 0x7f0e580c9a80 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e60184640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0e580caf80 con 0x7f0e580b7ba0 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 0x7f0e581e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 0x7f0e581e9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33524/0 (socket says 172.21.15.42:33524) 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 -- 172.21.15.42:0/3718711593 learned_addr learned my addr 172.21.15.42:0/3718711593 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5e721640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e580c9a80 0x7f0e581542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5df20640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e580b7ba0 0x7f0e580d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 -- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e580b7ba0 msgr2=0x7f0e580d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e580b7ba0 0x7f0e580d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 -- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e580c9a80 msgr2=0x7f0e581542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e580c9a80 0x7f0e581542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.152+0000 7f0e5d71f640 1 -- 172.21.15.42:0/3718711593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e580d0ce0 con 0x7f0e580c9500 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.153+0000 7f0e5d71f640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 0x7f0e581e9bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000c00 tx=0x7f0e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.153+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c041020 con 0x7f0e580c9500 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.153+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0306c0 con 0x7f0e580c9500 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.153+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e581520f0 con 0x7f0e580c9500 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.153+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c037040 con 0x7f0e580c9500 2024-05-09T01:42:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.153+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e581526b0 con 0x7f0e580c9500 2024-05-09T01:42:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.154+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5806e4a0 con 0x7f0e580c9500 2024-05-09T01:42:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.154+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e4c044020 con 0x7f0e580c9500 2024-05-09T01:42:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.155+0000 7f0e567fc640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0e440762d0 0x7f0e440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.155+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f0e4c0b7d30 con 0x7f0e580c9500 2024-05-09T01:42:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.155+0000 7f0e5df20640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0e440762d0 0x7f0e440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.156+0000 7f0e5df20640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0e440762d0 0x7f0e440787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0e50006e80 tx=0x7f0e50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.160+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e5806e4a0 con 0x7f0e580c9500 2024-05-09T01:42:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.390+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e58156180 con 0x7f0e580c9500 2024-05-09T01:42:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.390+0000 7f0e567fc640 1 -- 172.21.15.42:0/3718711593 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f0e4c04b030 con 0x7f0e580c9500 2024-05-09T01:42:21.389 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:42:21.389 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:42:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0e440762d0 msgr2=0x7f0e440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0e440762d0 0x7f0e440787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0e50006e80 tx=0x7f0e50008040 comp rx=0 tx=0).stop 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 msgr2=0x7f0e581e9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 0x7f0e581e9bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000c00 tx=0x7f0e4c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 shutdown_connections 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0e440762d0 0x7f0e440787e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e580c9a80 0x7f0e581542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e580c9500 0x7f0e581e9bc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 --2- 172.21.15.42:0/3718711593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e580b7ba0 0x7f0e580d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.392+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 >> 172.21.15.42:0/3718711593 conn(0x7f0e580d2100 msgr2=0x7f0e580c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.393+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 shutdown_connections 2024-05-09T01:42:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.393+0000 7f0e60184640 1 -- 172.21.15.42:0/3718711593 wait complete. 2024-05-09T01:42:21.401 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db / --timeout 90 --expiration 144.95 --await-for 45.0' 2024-05-09T01:42:21.401 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db / --timeout 90 --expiration 144.95 --await-for 45.0 2024-05-09T01:42:21.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.528+0000 7f06be714640 1 Processor -- start 2024-05-09T01:42:21.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.528+0000 7f06be714640 1 -- start start 2024-05-09T01:42:21.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06be714640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06b80c76f0 0x7f06b80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06be714640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80b4e00 0x7f06b806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06be714640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b815cf00 con 0x7f06b806db10 2024-05-09T01:42:21.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06be714640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f06b80ce800 con 0x7f06b80c76f0 2024-05-09T01:42:21.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06be714640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f06b80ccb30 con 0x7f06b80b4e00 2024-05-09T01:42:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80b4e00 0x7f06b806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06b7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06b80c76f0 0x7f06b80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06bccb1640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f06b806db10 0x7f06b81602e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:56152/0 (socket says 172.21.15.42:56152) 2024-05-09T01:42:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06bccb1640 1 -- 172.21.15.42:0/241287602 learned_addr learned my addr 172.21.15.42:0/241287602 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:42:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.530+0000 7f06b6ffd640 1 -- 172.21.15.42:0/241287602 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862666923 0 0) 0x7f06b815cf00 con 0x7f06b806db10 2024-05-09T01:42:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b6ffd640 1 -- 172.21.15.42:0/241287602 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06a0003520 con 0x7f06b806db10 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b77fe640 1 -- 172.21.15.42:0/241287602 >> v2:172.21.15.181:3300/0 conn(0x7f06b80c76f0 msgr2=0x7f06b80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b77fe640 1 --2- 172.21.15.42:0/241287602 >> v2:172.21.15.181:3300/0 conn(0x7f06b80c76f0 0x7f06b80cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b77fe640 1 -- 172.21.15.42:0/241287602 >> v1:172.21.15.181:6789/0 conn(0x7f06b806db10 legacy=0x7f06b81602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b77fe640 1 -- 172.21.15.42:0/241287602 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80ccd80 con 0x7f06b80b4e00 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b7fff640 1 --2- 172.21.15.42:0/241287602 >> v2:172.21.15.181:3300/0 conn(0x7f06b80c76f0 0x7f06b80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.531+0000 7f06b77fe640 1 --2- 172.21.15.42:0/241287602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80b4e00 0x7f06b806d5d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097a0 tx=0x7f06ac02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72da993e8f9d059f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06b6ffd640 1 -- 172.21.15.42:0/241287602 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac037070 con 0x7f06b80b4e00 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06b6ffd640 1 -- 172.21.15.42:0/241287602 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac02ae50 con 0x7f06b80b4e00 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06b6ffd640 1 -- 172.21.15.42:0/241287602 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac032640 con 0x7f06b80b4e00 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06be714640 1 -- 172.21.15.42:0/241287602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80b4e00 msgr2=0x7f06b806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06be714640 1 --2- 172.21.15.42:0/241287602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80b4e00 0x7f06b806d5d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097a0 tx=0x7f06ac02a100 comp rx=0 tx=0).stop 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06be714640 1 -- 172.21.15.42:0/241287602 shutdown_connections 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06be714640 1 --2- 172.21.15.42:0/241287602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80b4e00 0x7f06b806d5d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06be714640 1 --2- 172.21.15.42:0/241287602 >> v2:172.21.15.181:3300/0 conn(0x7f06b80c76f0 0x7f06b80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.532+0000 7f06be714640 1 -- 172.21.15.42:0/241287602 >> 172.21.15.42:0/241287602 conn(0x7f06b8068de0 msgr2=0x7f06b80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.533+0000 7f06be714640 1 -- 172.21.15.42:0/241287602 shutdown_connections 2024-05-09T01:42:21.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.533+0000 7f06be714640 1 -- 172.21.15.42:0/241287602 wait complete. 2024-05-09T01:42:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.534+0000 7f06be714640 1 Processor -- start 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.534+0000 7f06be714640 1 -- start start 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06be714640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b806db10 0x7f06b81f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06be714640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 0x7f06b815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06be714640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80c76f0 0x7f06b80cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06be714640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06b80ce4a0 con 0x7f06b80b4e00 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06be714640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06b80cd3d0 con 0x7f06b806db10 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06be714640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f06b81572c0 con 0x7f06b80c76f0 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 0x7f06b815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b806db10 0x7f06b81f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 0x7f06b815c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33540/0 (socket says 172.21.15.42:33540) 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 -- 172.21.15.42:0/1540271942 learned_addr learned my addr 172.21.15.42:0/1540271942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06bccb1640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80c76f0 0x7f06b80cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 -- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80c76f0 msgr2=0x7f06b80cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80c76f0 0x7f06b80cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 -- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b806db10 msgr2=0x7f06b81f7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b806db10 0x7f06b81f7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 -- 172.21.15.42:0/1540271942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80d2240 con 0x7f06b80b4e00 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.536+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 0x7f06b815c160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097a0 tx=0x7f06ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.537+0000 7f06b4ff9640 1 -- 172.21.15.42:0/1540271942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac041020 con 0x7f06b80b4e00 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.537+0000 7f06b4ff9640 1 -- 172.21.15.42:0/1540271942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0044c0 con 0x7f06b80b4e00 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.537+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b81f3240 con 0x7f06b80b4e00 2024-05-09T01:42:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.537+0000 7f06b4ff9640 1 -- 172.21.15.42:0/1540271942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac037040 con 0x7f06b80b4e00 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.537+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b81f3800 con 0x7f06b80b4e00 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.539+0000 7f06b4ff9640 1 -- 172.21.15.42:0/1540271942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06ac044020 con 0x7f06b80b4e00 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.539+0000 7f06b4ff9640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06a40762d0 0x7f06a40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.540+0000 7f06b4ff9640 1 -- 172.21.15.42:0/1540271942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f06ac0b7880 con 0x7f06b80b4e00 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.540+0000 7f06b7fff640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06a40762d0 0x7f06a40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.540+0000 7f06c55ca740 1 Processor -- start 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.540+0000 7f06c55ca740 1 -- start start 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.541+0000 7f06b7fff640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06a40762d0 0x7f06a40787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009560 tx=0x7f06a8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.541+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123e057b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 0x557123e449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e29f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06c55ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557123d69960 con 0x557123a38ab0 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557123d22b70 con 0x557123a40c90 2024-05-09T01:42:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x557123d65920 con 0x557123a61970 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 0x557123e449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 0x557123e449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33556/0 (socket says 172.21.15.42:33556) 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 -- 172.21.15.42:0/1264087580 learned_addr learned my addr 172.21.15.42:0/1264087580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b7fff640 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123e057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06bccb1640 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e29f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 -- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 msgr2=0x557123e057b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123e057b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 -- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 msgr2=0x557123e29f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e29f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 -- 172.21.15.42:0/1264087580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557123accf50 con 0x557123a38ab0 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06bccb1640 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e29f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 0x557123e449d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06ac07cb90 tx=0x7f06ac006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e111f5dd4028871 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f069dffb640 1 -- 172.21.15.42:0/1264087580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac089180 con 0x557123a38ab0 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f069dffb640 1 -- 172.21.15.42:0/1264087580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac080b10 con 0x557123a38ab0 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.542+0000 7f069dffb640 1 -- 172.21.15.42:0/1264087580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0872e0 con 0x557123a38ab0 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 -- 172.21.15.42:0/1264087580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 msgr2=0x557123e449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 0x557123e449d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06ac07cb90 tx=0x7f06ac006e10 comp rx=0 tx=0).stop 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 -- 172.21.15.42:0/1264087580 shutdown_connections 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e29f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a38ab0 0x557123e449d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1264087580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123e057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 -- 172.21.15.42:0/1264087580 >> 172.21.15.42:0/1264087580 conn(0x557123a55ac0 msgr2=0x557123e046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 -- 172.21.15.42:0/1264087580 shutdown_connections 2024-05-09T01:42:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.543+0000 7f06c55ca740 1 -- 172.21.15.42:0/1264087580 wait complete. 2024-05-09T01:42:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.544+0000 7f06c55ca740 1 -- start start 2024-05-09T01:42:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.544+0000 7f06c55ca740 1 Processor -- start 2024-05-09T01:42:21.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.545+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a38ab0 0x557123e40dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.545+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.545+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e4ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557123d22b70 con 0x557123a61970 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557123cf0490 con 0x557123a40c90 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x557123d69960 con 0x557123a38ab0 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e4ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 10 client.0 _ll_register_callbacks cb 0x557123cec5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e4ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33566/0 (socket says 172.21.15.42:33566) 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 -- 172.21.15.42:0/3559302109 learned_addr learned my addr 172.21.15.42:0/3559302109 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06b77fe640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06b7fff640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a38ab0 0x557123e40dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 -- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a38ab0 msgr2=0x557123e40dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a38ab0 0x557123e40dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 -- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 msgr2=0x557123e485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 -- 172.21.15.42:0/3559302109 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557123b43db0 con 0x557123a61970 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06b7fff640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a38ab0 0x557123e40dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06bccb1640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e4ac00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06b0007740 tx=0x7f06b0007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4bb9a36de5c638 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f0696ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f0696ffd640 1 -- 172.21.15.42:0/3559302109 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0019030 con 0x557123a61970 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f0696ffd640 1 -- 172.21.15.42:0/3559302109 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f06b0010040 con 0x557123a61970 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06ac080b10 con 0x557123a61970 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f0696ffd640 1 -- 172.21.15.42:0/3559302109 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f06b0022050 con 0x557123a61970 2024-05-09T01:42:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 10 client.4959 fetch_fsmap learned FSMap version 16 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.546+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x557123e47dc0 con 0x557123a61970 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f0696ffd640 1 -- 172.21.15.42:0/3559302109 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac080b10 con 0x557123a61970 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f0696ffd640 1 -- 172.21.15.42:0/3559302109 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f06b0025020 con 0x557123a61970 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06c55ca740 10 client.4959 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06c55ca740 10 client.4959 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06c55ca740 20 client.4959 populate_metadata read hostname 'smithi042' 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06c55ca740 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123a20750 0x557123e26b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06c55ca740 4 client.4959 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557123d773b0 con 0x557123a20750 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06b7fff640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123a20750 0x557123e26b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f0696ffd640 10 client.4959 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.547+0000 7f06b7fff640 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123a20750 0x557123e26b70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a3bdf7f78ad9863 server_cookie=53c08f333ef21be5 in_seq=0 out_seq=0 2024-05-09T01:42:21.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.548+0000 7f0696ffd640 1 -- 172.21.15.42:0/3559302109 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557123d773b0 con 0x557123a20750 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.548+0000 7f0696ffd640 10 client.4959 handle_command_reply: tid=0 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.548+0000 7f06c55ca740 1 client.4959 shutdown 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.548+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 msgr2=0x557123e4ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.548+0000 7f06c55ca740 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e4ac00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06b0007740 tx=0x7f06b0007830 comp rx=0 tx=0).stop 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 shutdown_connections 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123a20750 0x557123e26b70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e4ac00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a40c90 0x557123e485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f0696ffd640 0 client.4959 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 --2- 172.21.15.42:0/3559302109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a38ab0 0x557123e40dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 >> 172.21.15.42:0/3559302109 conn(0x557123a55ac0 msgr2=0x557123dff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 shutdown_connections 2024-05-09T01:42:21.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 1 -- 172.21.15.42:0/3559302109 wait complete. 2024-05-09T01:42:21.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.549+0000 7f06c55ca740 20 client.4959 trim_cache size 0 max 16384 2024-05-09T01:42:21.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.567+0000 7f06c55ca740 1 Processor -- start 2024-05-09T01:42:21.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.567+0000 7f06c55ca740 1 -- start start 2024-05-09T01:42:21.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e3fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 0x557123ebec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123ebf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06c55ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8200690 con 0x557123a40c90 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06b81feb50 con 0x557123a38ab0 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f06b81fffc0 con 0x557123a61970 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 0x557123ebec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 0x557123ebec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33580/0 (socket says 172.21.15.42:33580) 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.568+0000 7f06b77fe640 1 -- 172.21.15.42:0/1130277432 learned_addr learned my addr 172.21.15.42:0/1130277432 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b7fff640 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e3fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06bccb1640 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123ebf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b77fe640 1 -- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 msgr2=0x557123ebf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123ebf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b77fe640 1 -- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 msgr2=0x557123e3fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e3fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b77fe640 1 -- 172.21.15.42:0/1130277432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557123e48230 con 0x557123a40c90 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b7fff640 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e3fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f06b77fe640 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 0x557123ebec50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06ac080a50 tx=0x7f06ac033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4c070f6997bc2e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f069d7fa640 1 -- 172.21.15.42:0/1130277432 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac080b10 con 0x557123a40c90 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f069d7fa640 1 -- 172.21.15.42:0/1130277432 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac084e10 con 0x557123a40c90 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.569+0000 7f069d7fa640 1 -- 172.21.15.42:0/1130277432 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0872e0 con 0x557123a40c90 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 -- 172.21.15.42:0/1130277432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 msgr2=0x557123ebec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 0x557123ebec50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06ac080a50 tx=0x7f06ac033000 comp rx=0 tx=0).stop 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 -- 172.21.15.42:0/1130277432 shutdown_connections 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a61970 0x557123ebf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a40c90 0x557123ebec50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 --2- 172.21.15.42:0/1130277432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e3fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 -- 172.21.15.42:0/1130277432 >> 172.21.15.42:0/1130277432 conn(0x557123a55ac0 msgr2=0x557123e469e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 -- 172.21.15.42:0/1130277432 shutdown_connections 2024-05-09T01:42:21.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 -- 172.21.15.42:0/1130277432 wait complete. 2024-05-09T01:42:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.570+0000 7f06c55ca740 1 -- start start 2024-05-09T01:42:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.571+0000 7f06c55ca740 1 Processor -- start 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e55220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a40c90 0x557123e539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e53f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06b81ff8f0 con 0x557123a61970 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06b81ff220 con 0x557123a38ab0 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f06b80d0070 con 0x557123a40c90 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06c55ca740 10 client.0 _ll_register_callbacks cb 0x7f06b0001d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e53f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e53f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33586/0 (socket says 172.21.15.42:33586) 2024-05-09T01:42:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 -- 172.21.15.42:0/2774816810 learned_addr learned my addr 172.21.15.42:0/2774816810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06b7fff640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e55220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06b77fe640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a40c90 0x557123e539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 -- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a40c90 msgr2=0x557123e539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a40c90 0x557123e539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 -- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 msgr2=0x557123e55220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e55220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.572+0000 7f06bccb1640 1 -- 172.21.15.42:0/2774816810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557123e4fae0 con 0x557123a61970 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06bccb1640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e53f00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06b00014c0 tx=0x7f06b0005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71e556bf47dfff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:21.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f0696ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f0696ffd640 1 -- 172.21.15.42:0/2774816810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0019070 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f0696ffd640 1 -- 172.21.15.42:0/2774816810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f06b0015670 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06ac084e10 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f0696ffd640 1 -- 172.21.15.42:0/2774816810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f06b0033050 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 10 client.4965 fetch_fsmap learned FSMap version 16 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x557123e4b2f0 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f0696ffd640 1 -- 172.21.15.42:0/2774816810 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac084e10 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f0696ffd640 1 -- 172.21.15.42:0/2774816810 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f06b0036020 con 0x557123a61970 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 10 client.4965 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 10 client.4965 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 20 client.4965 populate_metadata read hostname 'smithi042' 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123e68f40 0x557123ebe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:21.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 4 client.4965 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.95, "await_for": 45.0}] 2024-05-09T01:42:21.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.573+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.95, "await_for": 45.0}) -- 0x557123d713e0 con 0x557123e68f40 2024-05-09T01:42:21.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.574+0000 7f06b7fff640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123e68f40 0x557123ebe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:21.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.574+0000 7f0696ffd640 10 client.4965 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:21.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.574+0000 7f06b7fff640 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123e68f40 0x557123ebe2a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37c6c1c8549e59f8 server_cookie=4cf87024e134af3f in_seq=0 out_seq=0 2024-05-09T01:42:21.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f0696ffd640 1 -- 172.21.15.42:0/2774816810 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x557123d713e0 con 0x557123e68f40 2024-05-09T01:42:21.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f0696ffd640 10 client.4965 handle_command_reply: tid=0 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 client.4965 shutdown 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 msgr2=0x557123e53f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e53f00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06b00014c0 tx=0x7f06b0005b70 comp rx=0 tx=0).stop 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 shutdown_connections 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x557123e68f40 0x557123ebe2a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557123a61970 0x557123e53f00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557123a40c90 0x557123e539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 --2- 172.21.15.42:0/2774816810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557123a38ab0 0x557123e55220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f0696ffd640 0 client.4965 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 >> 172.21.15.42:0/2774816810 conn(0x557123a55ac0 msgr2=0x557123e4e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 shutdown_connections 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 1 -- 172.21.15.42:0/2774816810 wait complete. 2024-05-09T01:42:21.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.577+0000 7f06c55ca740 20 client.4965 trim_cache size 0 max 16384 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 6, 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "b0951c0d": { 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 6, 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-05-09T01:42:21.580 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 144.9, 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.582 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:21.582 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:42:21.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06a40762d0 msgr2=0x7f06a40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06a40762d0 0x7f06a40787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009560 tx=0x7f06a8009190 comp rx=0 tx=0).stop 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 msgr2=0x7f06b815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 0x7f06b815c160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097a0 tx=0x7f06ac0046c0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 shutdown_connections 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f06a40762d0 0x7f06a40787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06b80c76f0 0x7f06b80cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06b80b4e00 0x7f06b815c160 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 --2- 172.21.15.42:0/1540271942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b806db10 0x7f06b81f7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 >> 172.21.15.42:0/1540271942 conn(0x7f06b8068de0 msgr2=0x7f06b80cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 shutdown_connections 2024-05-09T01:42:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:21.578+0000 7f06be714640 1 -- 172.21.15.42:0/1540271942 wait complete. 2024-05-09T01:42:21.586 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b0951c0d', quiesce took 0.6 seconds. Will release after: 24.349999999999998 2024-05-09T01:42:31.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:42:31.451 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:42:45.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.067+0000 7fd48df1f640 1 Processor -- start 2024-05-09T01:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.067+0000 7fd48df1f640 1 -- start start 2024-05-09T01:42:46.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd48df1f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd48806d500 0x7fd4880c9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd48df1f640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd488160f60 con 0x7fd488156d20 2024-05-09T01:42:46.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd48df1f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4881611d0 con 0x7fd48815dbb0 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd48df1f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd4880c9d80 con 0x7fd48806d500 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd486ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd48806d500 0x7fd4880c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd487fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd488156d20 0x7fd488167840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36758/0 (socket says 172.21.15.42:36758) 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.068+0000 7fd487fff640 1 -- 172.21.15.42:0/3869160573 learned_addr learned my addr 172.21.15.42:0/3869160573 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.069+0000 7fd486ffd640 1 -- 172.21.15.42:0/3869160573 >> v1:172.21.15.181:6789/0 conn(0x7fd48815dbb0 legacy=0x7fd4880cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.069+0000 7fd486ffd640 1 -- 172.21.15.42:0/3869160573 >> v1:172.21.15.42:6789/0 conn(0x7fd488156d20 legacy=0x7fd488167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.069+0000 7fd486ffd640 1 -- 172.21.15.42:0/3869160573 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48815d0d0 con 0x7fd48806d500 2024-05-09T01:42:46.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.070+0000 7fd486ffd640 1 --2- 172.21.15.42:0/3869160573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd48806d500 0x7fd4880c9840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0097a0 tx=0x7fd47c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcdbbae30839ea6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.070+0000 7fd4867fc640 1 -- 172.21.15.42:0/3869160573 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c037070 con 0x7fd48806d500 2024-05-09T01:42:46.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.070+0000 7fd4867fc640 1 -- 172.21.15.42:0/3869160573 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c032440 con 0x7fd48806d500 2024-05-09T01:42:46.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.070+0000 7fd4867fc640 1 -- 172.21.15.42:0/3869160573 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c032810 con 0x7fd48806d500 2024-05-09T01:42:46.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 -- 172.21.15.42:0/3869160573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd48806d500 msgr2=0x7fd4880c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 --2- 172.21.15.42:0/3869160573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd48806d500 0x7fd4880c9840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0097a0 tx=0x7fd47c02a230 comp rx=0 tx=0).stop 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 -- 172.21.15.42:0/3869160573 shutdown_connections 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 --2- 172.21.15.42:0/3869160573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd48806d500 0x7fd4880c9840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 -- 172.21.15.42:0/3869160573 >> 172.21.15.42:0/3869160573 conn(0x7fd48806fad0 msgr2=0x7fd488071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 -- 172.21.15.42:0/3869160573 shutdown_connections 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.071+0000 7fd48df1f640 1 -- 172.21.15.42:0/3869160573 wait complete. 2024-05-09T01:42:46.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.072+0000 7fd48df1f640 1 Processor -- start 2024-05-09T01:42:46.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.073+0000 7fd48df1f640 1 -- start start 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd48df1f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd48806d500 0x7fd488159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd48df1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 0x7fd4881586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd48df1f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd48815dbb0 0x7fd4880cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd48df1f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd48815d720 con 0x7fd488156d20 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd48df1f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880cc190 con 0x7fd48806d500 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd48df1f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880c7050 con 0x7fd48815dbb0 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 0x7fd4881586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 0x7fd4881586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59364/0 (socket says 172.21.15.42:59364) 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd486ffd640 1 -- 172.21.15.42:0/2355246527 learned_addr learned my addr 172.21.15.42:0/2355246527 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd4877fe640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd48806d500 0x7fd488159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.074+0000 7fd487fff640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd48815dbb0 0x7fd4880cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd486ffd640 1 -- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd48815dbb0 msgr2=0x7fd4880cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd486ffd640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd48815dbb0 0x7fd4880cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd486ffd640 1 -- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd48806d500 msgr2=0x7fd488159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd486ffd640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd48806d500 0x7fd488159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd486ffd640 1 -- 172.21.15.42:0/2355246527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd488158c10 con 0x7fd488156d20 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd487fff640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd48815dbb0 0x7fd4880cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd4877fe640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd48806d500 0x7fd488159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd486ffd640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 0x7fd4881586d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd47c035040 tx=0x7fd47c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c037040 con 0x7fd488156d20 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c030770 con 0x7fd488156d20 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd488160250 con 0x7fd488156d20 2024-05-09T01:42:46.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c030b80 con 0x7fd488156d20 2024-05-09T01:42:46.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.075+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd488158e20 con 0x7fd488156d20 2024-05-09T01:42:46.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.076+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48815a8e0 con 0x7fd488156d20 2024-05-09T01:42:46.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.078+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd47c044020 con 0x7fd488156d20 2024-05-09T01:42:46.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.079+0000 7fd46ffff640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd474076300 0x7fd474078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.079+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd47c0b7d20 con 0x7fd488156d20 2024-05-09T01:42:46.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.079+0000 7fd4877fe640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd474076300 0x7fd474078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.080+0000 7fd4877fe640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd474076300 0x7fd474078810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd478007fd0 tx=0x7fd478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.088+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd47c032e20 con 0x7fd488156d20 2024-05-09T01:42:46.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.332+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4881604f0 con 0x7fd488156d20 2024-05-09T01:42:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.333+0000 7fd46ffff640 1 -- 172.21.15.42:0/2355246527 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7fd47c081570 con 0x7fd488156d20 2024-05-09T01:42:46.330 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:42:46.330 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:42:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:42:46.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd474076300 msgr2=0x7fd474078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd474076300 0x7fd474078810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd478007fd0 tx=0x7fd478009040 comp rx=0 tx=0).stop 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 msgr2=0x7fd4881586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 0x7fd4881586d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd47c035040 tx=0x7fd47c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 shutdown_connections 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd474076300 0x7fd474078810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd48815dbb0 0x7fd4880cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd488156d20 0x7fd4881586d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 --2- 172.21.15.42:0/2355246527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd48806d500 0x7fd488159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 >> 172.21.15.42:0/2355246527 conn(0x7fd48806fad0 msgr2=0x7fd4880c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 shutdown_connections 2024-05-09T01:42:46.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.335+0000 7fd48df1f640 1 -- 172.21.15.42:0/2355246527 wait complete. 2024-05-09T01:42:46.348 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db --set-id b0951c0d --release --await' 2024-05-09T01:42:46.348 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db --set-id b0951c0d --release --await 2024-05-09T01:42:46.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.478+0000 7f84ff843640 1 Processor -- start 2024-05-09T01:42:46.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.479+0000 7f84ff843640 1 -- start start 2024-05-09T01:42:46.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84ff843640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84f8153d50 0x7f84f8070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84ff843640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f80713d0 0x7f84f81645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84ff843640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f8074d50 con 0x7f84f80c88e0 2024-05-09T01:42:46.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84ff843640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f84f8073ee0 con 0x7f84f8153d50 2024-05-09T01:42:46.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84ff843640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f84f8154160 con 0x7f84f80713d0 2024-05-09T01:42:46.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84fd5df640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f84f80c88e0 0x7f84f80737d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36766/0 (socket says 172.21.15.42:36766) 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84fd5df640 1 -- 172.21.15.42:0/632310681 learned_addr learned my addr 172.21.15.42:0/632310681 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.480+0000 7f84fcdde640 1 --2- 172.21.15.42:0/632310681 >> v2:172.21.15.181:3300/0 conn(0x7f84f8153d50 0x7f84f8070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84fdde0640 1 --2- 172.21.15.42:0/632310681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f80713d0 0x7f84f81645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84effff640 1 -- 172.21.15.42:0/632310681 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464995948 0 0) 0x7f84f8074d50 con 0x7f84f80c88e0 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84effff640 1 -- 172.21.15.42:0/632310681 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84e4003520 con 0x7f84f80c88e0 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84fdde0640 1 -- 172.21.15.42:0/632310681 >> v2:172.21.15.181:3300/0 conn(0x7f84f8153d50 msgr2=0x7f84f8070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84fdde0640 1 --2- 172.21.15.42:0/632310681 >> v2:172.21.15.181:3300/0 conn(0x7f84f8153d50 0x7f84f8070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84fdde0640 1 -- 172.21.15.42:0/632310681 >> v1:172.21.15.42:6789/0 conn(0x7f84f80c88e0 legacy=0x7f84f80737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84fdde0640 1 -- 172.21.15.42:0/632310681 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f80c8dd0 con 0x7f84f80713d0 2024-05-09T01:42:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.481+0000 7f84fcdde640 1 --2- 172.21.15.42:0/632310681 >> v2:172.21.15.181:3300/0 conn(0x7f84f8153d50 0x7f84f8070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.482+0000 7f84fdde0640 1 --2- 172.21.15.42:0/632310681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f80713d0 0x7f84f81645d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009d90 tx=0x7f84f002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2613dbfb2b89233 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.482+0000 7f84effff640 1 -- 172.21.15.42:0/632310681 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0007740 con 0x7f84f80713d0 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.482+0000 7f84effff640 1 -- 172.21.15.42:0/632310681 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f00078e0 con 0x7f84f80713d0 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.482+0000 7f84effff640 1 -- 172.21.15.42:0/632310681 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0007cb0 con 0x7f84f80713d0 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.483+0000 7f84ff843640 1 -- 172.21.15.42:0/632310681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f80713d0 msgr2=0x7f84f81645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.483+0000 7f84ff843640 1 --2- 172.21.15.42:0/632310681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f80713d0 0x7f84f81645d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009d90 tx=0x7f84f002a660 comp rx=0 tx=0).stop 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.483+0000 7f84ff843640 1 -- 172.21.15.42:0/632310681 shutdown_connections 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.483+0000 7f84ff843640 1 --2- 172.21.15.42:0/632310681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f80713d0 0x7f84f81645d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.483+0000 7f84ff843640 1 --2- 172.21.15.42:0/632310681 >> v2:172.21.15.181:3300/0 conn(0x7f84f8153d50 0x7f84f8070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.483+0000 7f84ff843640 1 -- 172.21.15.42:0/632310681 >> 172.21.15.42:0/632310681 conn(0x7f84f80cb850 msgr2=0x7f84f80cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.484+0000 7f84ff843640 1 -- 172.21.15.42:0/632310681 shutdown_connections 2024-05-09T01:42:46.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.484+0000 7f84ff843640 1 -- 172.21.15.42:0/632310681 wait complete. 2024-05-09T01:42:46.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.485+0000 7f84ff843640 1 Processor -- start 2024-05-09T01:42:46.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.485+0000 7f84ff843640 1 -- start start 2024-05-09T01:42:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84ff843640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 0x7f84f81410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84ff843640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84f80c88e0 0x7f84f81473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84ff843640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f8153d50 0x7f84f81478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84ff843640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84f815a280 con 0x7f84f80713d0 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84ff843640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84f8159fa0 con 0x7f84f80c88e0 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84ff843640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f84f815a560 con 0x7f84f8153d50 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 0x7f84f81410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 0x7f84f81410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59376/0 (socket says 172.21.15.42:59376) 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 -- 172.21.15.42:0/142462494 learned_addr learned my addr 172.21.15.42:0/142462494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fcdde640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84f80c88e0 0x7f84f81473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fdde0640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f8153d50 0x7f84f81478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 -- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f8153d50 msgr2=0x7f84f81478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f8153d50 0x7f84f81478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 -- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84f80c88e0 msgr2=0x7f84f81473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84f80c88e0 0x7f84f81473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.487+0000 7f84fd5df640 1 -- 172.21.15.42:0/142462494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f8149120 con 0x7f84f80713d0 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.488+0000 7f84fd5df640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 0x7f84f81410e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f84f4007fd0 tx=0x7f84f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.488+0000 7f84edffb640 1 -- 172.21.15.42:0/142462494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40074e0 con 0x7f84f80713d0 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.488+0000 7f84edffb640 1 -- 172.21.15.42:0/142462494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f40047e0 con 0x7f84f80713d0 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.488+0000 7f84edffb640 1 -- 172.21.15.42:0/142462494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4004c10 con 0x7f84f80713d0 2024-05-09T01:42:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.488+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f80cd9a0 con 0x7f84f80713d0 2024-05-09T01:42:46.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.488+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f80cdf60 con 0x7f84f80713d0 2024-05-09T01:42:46.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.490+0000 7f84edffb640 1 -- 172.21.15.42:0/142462494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84f401d3f0 con 0x7f84f80713d0 2024-05-09T01:42:46.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.491+0000 7f84edffb640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f84dc0762d0 0x7f84dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.491+0000 7f84edffb640 1 -- 172.21.15.42:0/142462494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f84f40971b0 con 0x7f84f80713d0 2024-05-09T01:42:46.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.491+0000 7f84fcdde640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f84dc0762d0 0x7f84dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.492+0000 7f84fcdde640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f84dc0762d0 0x7f84dc0787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f84f80cb000 tx=0x7f84e8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.493+0000 7f85067d9740 1 Processor -- start 2024-05-09T01:42:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.493+0000 7f85067d9740 1 -- start start 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f85067d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa48ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa49430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f85067d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec2f988890 con 0x55ec2f6808c0 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f85067d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ec2f924620 con 0x55ec2f657a00 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f85067d9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ec2f984850 con 0x55ec2f65fbe0 2024-05-09T01:42:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59380/0 (socket says 172.21.15.42:59380) 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f84fd5df640 1 -- 172.21.15.42:0/4203640994 learned_addr learned my addr 172.21.15.42:0/4203640994 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f84fcdde640 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa48ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.494+0000 7f84fdde0640 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa49430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84fd5df640 1 -- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 msgr2=0x55ec2fa49430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84fd5df640 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa49430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84fd5df640 1 -- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 msgr2=0x55ec2fa48ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84fd5df640 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa48ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84fd5df640 1 -- 172.21.15.42:0/4203640994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2f94fa70 con 0x55ec2f6808c0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84fd5df640 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa658d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f84f405c900 tx=0x7f84f4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6a4951da40f629 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84daffd640 1 -- 172.21.15.42:0/4203640994 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40690c0 con 0x55ec2f6808c0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84daffd640 1 -- 172.21.15.42:0/4203640994 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f405f570 con 0x55ec2f6808c0 2024-05-09T01:42:46.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.495+0000 7f84daffd640 1 -- 172.21.15.42:0/4203640994 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40640b0 con 0x55ec2f6808c0 2024-05-09T01:42:46.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 -- 172.21.15.42:0/4203640994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 msgr2=0x55ec2fa658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa658d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f84f405c900 tx=0x7f84f4001250 comp rx=0 tx=0).stop 2024-05-09T01:42:46.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 -- 172.21.15.42:0/4203640994 shutdown_connections 2024-05-09T01:42:46.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa49430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa48ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 --2- 172.21.15.42:0/4203640994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa658d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 -- 172.21.15.42:0/4203640994 >> 172.21.15.42:0/4203640994 conn(0x55ec2f674a10 msgr2=0x55ec2fa234f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 -- 172.21.15.42:0/4203640994 shutdown_connections 2024-05-09T01:42:46.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.496+0000 7f85067d9740 1 -- 172.21.15.42:0/4203640994 wait complete. 2024-05-09T01:42:46.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.497+0000 7f85067d9740 1 -- start start 2024-05-09T01:42:46.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.497+0000 7f85067d9740 1 Processor -- start 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa75aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa61f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa75aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa75aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60842/0 (socket says 172.21.15.42:60842) 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 -- 172.21.15.42:0/1280664491 learned_addr learned my addr 172.21.15.42:0/1280664491 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec2fa23350 con 0x55ec2f6808c0 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ec2f910330 con 0x55ec2f657a00 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ec2fa763a0 con 0x55ec2f65fbe0 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fcdde640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fdde0640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa61f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f85067d9740 10 client.0 _ll_register_callbacks cb 0x55ec2f90bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 -- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 msgr2=0x55ec2fa456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 -- 172.21.15.42:0/1280664491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 msgr2=0x55ec2fa61f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa61f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.499+0000 7f84fd5df640 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2f6ebea0 con 0x55ec2f657a00 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f84fd5df640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa75aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f84f405c900 tx=0x7f84f4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebdf576ff8515a75 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f84d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f84d3fff640 1 -- 172.21.15.42:0/1280664491 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40642b0 con 0x55ec2f657a00 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f84d3fff640 1 -- 172.21.15.42:0/1280664491 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f84f4062cc0 con 0x55ec2f657a00 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84f405f570 con 0x55ec2f657a00 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f84d3fff640 1 -- 172.21.15.42:0/1280664491 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f84f4062ec0 con 0x55ec2f657a00 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f85067d9740 10 client.4891 fetch_fsmap learned FSMap version 16 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55ec2f762d00 con 0x55ec2f657a00 2024-05-09T01:42:46.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.500+0000 7f84d3fff640 1 -- 172.21.15.42:0/1280664491 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f4075070 con 0x55ec2f657a00 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f84d3fff640 1 -- 172.21.15.42:0/1280664491 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f84f401c030 con 0x55ec2f657a00 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f85067d9740 10 client.4891 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f85067d9740 10 client.4891 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f85067d9740 20 client.4891 populate_metadata read hostname 'smithi042' 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f85067d9740 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f63f490 0x55ec2fa5e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f85067d9740 4 client.4891 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84f405f570 con 0x55ec2f63f490 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.501+0000 7f84fcdde640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f63f490 0x55ec2fa5e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.502+0000 7f84fcdde640 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f63f490 0x55ec2fa5e830 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa3ccf2853cc65b server_cookie=2acdb5d62383c110 in_seq=0 out_seq=0 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.502+0000 7f84d3fff640 10 client.4891 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.502+0000 7f84d3fff640 1 -- 172.21.15.42:0/1280664491 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f84f405f570 con 0x55ec2f63f490 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.502+0000 7f84d3fff640 10 client.4891 handle_command_reply: tid=0 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.502+0000 7f85067d9740 1 client.4891 shutdown 2024-05-09T01:42:46.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 msgr2=0x55ec2fa75aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa75aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f84f405c900 tx=0x7f84f4000ed0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 shutdown_connections 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f63f490 0x55ec2fa5e830 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f84d3fff640 0 client.4891 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f6808c0 0x55ec2fa61f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f65fbe0 0x55ec2fa456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 --2- 172.21.15.42:0/1280664491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa75aa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 >> 172.21.15.42:0/1280664491 conn(0x55ec2f674a10 msgr2=0x55ec2fa1eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 shutdown_connections 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 1 -- 172.21.15.42:0/1280664491 wait complete. 2024-05-09T01:42:46.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.503+0000 7f85067d9740 20 client.4891 trim_cache size 0 max 16384 2024-05-09T01:42:46.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.539+0000 7f85067d9740 1 Processor -- start 2024-05-09T01:42:46.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.539+0000 7f85067d9740 1 -- start start 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.540+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f63f490 0x55ec2fa75b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.540+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa5bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.540+0000 7f85067d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 0x55ec2fa5c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.540+0000 7f85067d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84f814d160 con 0x55ec2f65fbe0 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.540+0000 7f85067d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84f813bed0 con 0x55ec2f657a00 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.540+0000 7f85067d9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f84f814ca90 con 0x55ec2f63f490 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 0x55ec2fa5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 0x55ec2fa5c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59394/0 (socket says 172.21.15.42:59394) 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 -- 172.21.15.42:0/2220787338 learned_addr learned my addr 172.21.15.42:0/2220787338 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:46.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fcdde640 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa5bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fd5df640 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f63f490 0x55ec2fa75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 -- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f63f490 msgr2=0x55ec2fa75b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f63f490 0x55ec2fa75b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 -- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 msgr2=0x55ec2fa5bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa5bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 -- 172.21.15.42:0/2220787338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2fa626e0 con 0x55ec2f65fbe0 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fd5df640 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f63f490 0x55ec2fa75b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84fdde0640 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 0x55ec2fa5c520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f84f002ac50 tx=0x7f84f002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f4b1e92dc9bb80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.541+0000 7f84da7fc640 1 -- 172.21.15.42:0/2220787338 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0007b10 con 0x55ec2f65fbe0 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.542+0000 7f84da7fc640 1 -- 172.21.15.42:0/2220787338 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f004b070 con 0x55ec2f65fbe0 2024-05-09T01:42:46.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.542+0000 7f84da7fc640 1 -- 172.21.15.42:0/2220787338 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f003b410 con 0x55ec2f65fbe0 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 -- 172.21.15.42:0/2220787338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 msgr2=0x55ec2fa5c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 0x55ec2fa5c520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f84f002ac50 tx=0x7f84f002e000 comp rx=0 tx=0).stop 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 -- 172.21.15.42:0/2220787338 shutdown_connections 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f65fbe0 0x55ec2fa5c520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f657a00 0x55ec2fa5bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 --2- 172.21.15.42:0/2220787338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f63f490 0x55ec2fa75b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 -- 172.21.15.42:0/2220787338 >> 172.21.15.42:0/2220787338 conn(0x55ec2f674a10 msgr2=0x55ec2fa1a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 -- 172.21.15.42:0/2220787338 shutdown_connections 2024-05-09T01:42:46.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.543+0000 7f85067d9740 1 -- 172.21.15.42:0/2220787338 wait complete. 2024-05-09T01:42:46.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.544+0000 7f85067d9740 1 -- start start 2024-05-09T01:42:46.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.545+0000 7f85067d9740 1 Processor -- start 2024-05-09T01:42:46.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.547+0000 7f85067d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 0x55ec2fa229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.547+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f657a00 0x55ec2fa5b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.547+0000 7f85067d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f65fbe0 0x55ec2fadbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.547+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 0x55ec2fa229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.547+0000 7f84fd5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 0x55ec2fa229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59398/0 (socket says 172.21.15.42:59398) 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fd5df640 1 -- 172.21.15.42:0/1328246378 learned_addr learned my addr 172.21.15.42:0/1328246378 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84f814c3c0 con 0x55ec2f63f490 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fcdde640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f657a00 0x55ec2fa5b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84f814bcf0 con 0x55ec2f65fbe0 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fdde0640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f65fbe0 0x55ec2fadbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f84f8151880 con 0x55ec2f657a00 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f85067d9740 10 client.0 _ll_register_callbacks cb 0x7f84f4079070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fd5df640 1 -- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f657a00 msgr2=0x55ec2fa5b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fd5df640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f657a00 0x55ec2fa5b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fd5df640 1 -- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f65fbe0 msgr2=0x55ec2fadbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:42:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fd5df640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f65fbe0 0x55ec2fadbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.548+0000 7f84fd5df640 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2fa21ec0 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84fd5df640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 0x55ec2fa229b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84f4001eb0 tx=0x7f84f4095490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e786cdd8ec30f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84d3fff640 1 -- 172.21.15.42:0/1328246378 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f405c1d0 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84d3fff640 1 -- 172.21.15.42:0/1328246378 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f84f405c5a0 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84f004b070 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84d3fff640 1 -- 172.21.15.42:0/1328246378 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f84f405f570 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 10 client.4992 fetch_fsmap learned FSMap version 16 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55ec2fa21ec0 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84d3fff640 1 -- 172.21.15.42:0/1328246378 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f004b070 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f84d3fff640 1 -- 172.21.15.42:0/1328246378 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f84f401c040 con 0x55ec2f63f490 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 10 client.4992 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 10 client.4992 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:42:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 20 client.4992 populate_metadata read hostname 'smithi042' 2024-05-09T01:42:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f6148d0 0x55ec2fadc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:42:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 4 client.4992 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b0951c0d", "release": true, "await": true}] 2024-05-09T01:42:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.549+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b0951c0d", "release": true, "await": true}) -- 0x55ec2f9962e0 con 0x55ec2f6148d0 2024-05-09T01:42:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.550+0000 7f84fcdde640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f6148d0 0x55ec2fadc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:42:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.550+0000 7f84d3fff640 10 client.4992 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.551+0000 7f84fcdde640 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f6148d0 0x55ec2fadc040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f406af23f5d1b4 server_cookie=bb944b819b84272e in_seq=0 out_seq=0 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.552+0000 7f84d3fff640 1 -- 172.21.15.42:0/1328246378 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55ec2f9962e0 con 0x55ec2f6148d0 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.552+0000 7f84d3fff640 10 client.4992 handle_command_reply: tid=0 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.552+0000 7f85067d9740 1 client.4992 shutdown 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 msgr2=0x55ec2fa229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 0x55ec2fa229b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84f4001eb0 tx=0x7f84f4095490 comp rx=0 tx=0).stop 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 shutdown_connections 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ec2f6148d0 0x55ec2fadc040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ec2f65fbe0 0x55ec2fadbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ec2f657a00 0x55ec2fa5b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 --2- 172.21.15.42:0/1328246378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec2f63f490 0x55ec2fa229b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 >> 172.21.15.42:0/1328246378 conn(0x55ec2f674a10 msgr2=0x55ec2fa637e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f84d3fff640 0 client.4992 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 shutdown_connections 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 1 -- 172.21.15.42:0/1328246378 wait complete. 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.553+0000 7f85067d9740 20 client.4992 trim_cache size 0 max 16384 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:42:46.555 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 8, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "b0951c0d": { 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 8, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 144.9, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-05-09T01:42:46.556 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:46.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:42:46.558 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f84dc0762d0 msgr2=0x7f84dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f84dc0762d0 0x7f84dc0787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f84f80cb000 tx=0x7f84e8009190 comp rx=0 tx=0).stop 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 msgr2=0x7f84f81410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 0x7f84f81410e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f84f4007fd0 tx=0x7f84f400c890 comp rx=0 tx=0).stop 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 shutdown_connections 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f84dc0762d0 0x7f84dc0787e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84f8153d50 0x7f84f81478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84f80c88e0 0x7f84f81473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 --2- 172.21.15.42:0/142462494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84f80713d0 0x7f84f81410e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:42:46.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 >> 172.21.15.42:0/142462494 conn(0x7f84f80cb850 msgr2=0x7f84f80c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:42:46.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 shutdown_connections 2024-05-09T01:42:46.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:42:46.554+0000 7f84ff843640 1 -- 172.21.15.42:0/142462494 wait complete. 2024-05-09T01:42:46.567 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b0951c0d', total seconds elapsed: 25.5 2024-05-09T01:43:01.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:43:01.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:43:11.224 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 90% (11051/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T01:43:11.796 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T01:43:11.796 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.796 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T01:43:11.796 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T01:43:11.796 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T01:43:11.796 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-09T01:43:11.797 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T01:43:11.803 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T01:43:11.825 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T01:43:11.827 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T01:43:11.828 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T01:43:12.378 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T01:43:12.436 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T01:43:12.478 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T01:43:12.479 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T01:43:12.479 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T01:43:12.521 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T01:43:12.524 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:43:12.524 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T01:43:12.581 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-09T01:43:12.582 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-09T01:43:12.582 DEBUG:teuthology.orchestra.run.smithi042:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-09T01:43:12.652 INFO:tasks.workunit.client.0.smithi042.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T01:43:12.724 INFO:tasks.workunit.client.0.smithi042.stdout: Iozone: Performance Test of File I/O 2024-05-09T01:43:12.724 INFO:tasks.workunit.client.0.smithi042.stdout: Version $Revision: 3.494 $ 2024-05-09T01:43:12.724 INFO:tasks.workunit.client.0.smithi042.stdout: Compiled for 64 bit mode. 2024-05-09T01:43:12.724 INFO:tasks.workunit.client.0.smithi042.stdout: Build: linux-AMD64 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Run began: Thu May 9 01:43:12 2024 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:12.725 INFO:tasks.workunit.client.0.smithi042.stdout: Include close in write timing 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Include fsync in write timing 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: File size set to 1048576 kB 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Record Size 16 kB 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Output is in kBytes/sec 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Processor cache line size set to 32 bytes. 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: File stride size set to 17 * record size. 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Throughput test with 1 process 2024-05-09T01:43:12.726 INFO:tasks.workunit.client.0.smithi042.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-09T01:43:23.273 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:23.273 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 initial writers = 99430.30 kB/sec 2024-05-09T01:43:23.273 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 initial writers = 99428.36 kB/sec 2024-05-09T01:43:23.274 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 99430.30 kB/sec 2024-05-09T01:43:23.274 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 99430.30 kB/sec 2024-05-09T01:43:23.274 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 99430.30 kB/sec 2024-05-09T01:43:23.274 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:43:31.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:43:31.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:43:38.554 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:38.554 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 rewriters = 112321.56 kB/sec 2024-05-09T01:43:38.554 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 rewriters = 112319.62 kB/sec 2024-05-09T01:43:38.554 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 112321.56 kB/sec 2024-05-09T01:43:38.554 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 112321.56 kB/sec 2024-05-09T01:43:38.554 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 112321.56 kB/sec 2024-05-09T01:43:38.555 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:43:42.148 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:42.148 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 readers = 7463388.50 kB/sec 2024-05-09T01:43:42.148 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 readers = 7454255.40 kB/sec 2024-05-09T01:43:42.148 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 7463388.50 kB/sec 2024-05-09T01:43:42.148 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 7463388.50 kB/sec 2024-05-09T01:43:42.149 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 7463388.50 kB/sec 2024-05-09T01:43:42.149 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:43:44.363 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:44.363 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 re-readers = 7134291.00 kB/sec 2024-05-09T01:43:44.363 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 re-readers = 7125702.79 kB/sec 2024-05-09T01:43:44.363 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 7134291.00 kB/sec 2024-05-09T01:43:44.364 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 7134291.00 kB/sec 2024-05-09T01:43:44.364 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 7134291.00 kB/sec 2024-05-09T01:43:44.364 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:43:50.631 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:50.632 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:50.632 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:50.632 INFO:tasks.workunit.client.0.smithi042.stdout:iozone test complete. 2024-05-09T01:43:50.632 INFO:tasks.workunit.client.0.smithi042.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T01:43:50.699 INFO:tasks.workunit.client.0.smithi042.stdout: Iozone: Performance Test of File I/O 2024-05-09T01:43:50.699 INFO:tasks.workunit.client.0.smithi042.stdout: Version $Revision: 3.494 $ 2024-05-09T01:43:50.699 INFO:tasks.workunit.client.0.smithi042.stdout: Compiled for 64 bit mode. 2024-05-09T01:43:50.699 INFO:tasks.workunit.client.0.smithi042.stdout: Build: linux-AMD64 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: Run began: Thu May 9 01:43:50 2024 2024-05-09T01:43:50.700 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Include close in write timing 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Include fsync in write timing 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: File size set to 1048576 kB 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Record Size 1024 kB 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Output is in kBytes/sec 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Processor cache line size set to 32 bytes. 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: File stride size set to 17 * record size. 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Throughput test with 1 process 2024-05-09T01:43:50.701 INFO:tasks.workunit.client.0.smithi042.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-09T01:43:52.337 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:52.337 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 initial writers = 654198.31 kB/sec 2024-05-09T01:43:52.337 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 initial writers = 654122.46 kB/sec 2024-05-09T01:43:52.337 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 654198.31 kB/sec 2024-05-09T01:43:52.337 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 654198.31 kB/sec 2024-05-09T01:43:52.338 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 654198.31 kB/sec 2024-05-09T01:43:52.338 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 rewriters = 780812.62 kB/sec 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 rewriters = 780682.50 kB/sec 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 780812.62 kB/sec 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 780812.62 kB/sec 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 780812.62 kB/sec 2024-05-09T01:43:56.034 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:43:58.420 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:43:58.421 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 readers = 7615548.50 kB/sec 2024-05-09T01:43:58.421 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 readers = 7601123.37 kB/sec 2024-05-09T01:43:58.421 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 7615548.50 kB/sec 2024-05-09T01:43:58.421 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 7615548.50 kB/sec 2024-05-09T01:43:58.421 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 7615548.50 kB/sec 2024-05-09T01:43:58.421 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:44:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 re-readers = 7989638.00 kB/sec 2024-05-09T01:44:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 re-readers = 7976379.55 kB/sec 2024-05-09T01:44:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 7989638.00 kB/sec 2024-05-09T01:44:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 7989638.00 kB/sec 2024-05-09T01:44:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 7989638.00 kB/sec 2024-05-09T01:44:00.632 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 1048576.00 kB 2024-05-09T01:44:01.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:44:01.932 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:44:06.982 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:06.982 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:06.983 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:06.983 INFO:tasks.workunit.client.0.smithi042.stdout:iozone test complete. 2024-05-09T01:44:06.983 INFO:tasks.workunit.client.0.smithi042.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Iozone: Performance Test of File I/O 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Version $Revision: 3.494 $ 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Compiled for 64 bit mode. 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Build: linux-AMD64 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T01:44:07.051 INFO:tasks.workunit.client.0.smithi042.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Run began: Thu May 9 01:44:06 2024 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Include close in write timing 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Include fsync in write timing 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: File size set to 10485760 kB 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Record Size 1024 kB 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T01:44:07.052 INFO:tasks.workunit.client.0.smithi042.stdout: Output is in kBytes/sec 2024-05-09T01:44:07.053 INFO:tasks.workunit.client.0.smithi042.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T01:44:07.053 INFO:tasks.workunit.client.0.smithi042.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T01:44:07.053 INFO:tasks.workunit.client.0.smithi042.stdout: Processor cache line size set to 32 bytes. 2024-05-09T01:44:07.053 INFO:tasks.workunit.client.0.smithi042.stdout: File stride size set to 17 * record size. 2024-05-09T01:44:07.053 INFO:tasks.workunit.client.0.smithi042.stdout: Throughput test with 1 process 2024-05-09T01:44:07.053 INFO:tasks.workunit.client.0.smithi042.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-09T01:44:19.240 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-05-09T01:44:19.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:44:19.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.413+0000 7f4c58de8640 1 Processor -- start 2024-05-09T01:44:19.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.413+0000 7f4c58de8640 1 -- start start 2024-05-09T01:44:19.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c58de8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 0x7f4c54161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c58de8640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c540c88b0 con 0x7f4c54073790 2024-05-09T01:44:19.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c52d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4c54073790 0x7f4c540707d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60354/0 (socket says 172.21.15.42:60354) 2024-05-09T01:44:19.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c52d9d640 1 -- 172.21.15.42:0/3943693525 learned_addr learned my addr 172.21.15.42:0/3943693525 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:44:19.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c540c8b90 con 0x7f4c54073380 2024-05-09T01:44:19.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4c540c8e70 con 0x7f4c5415b620 2024-05-09T01:44:19.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.416+0000 7f4c5259c640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 0x7f4c54161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874818905 0 0) 0x7f4c540c88b0 con 0x7f4c54073790 2024-05-09T01:44:19.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c40003520 con 0x7f4c54073790 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769629052 0 0) 0x7f4c540c8b90 con 0x7f4c54073380 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c540c88b0 con 0x7f4c54073380 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3709630613 0 0) 0x7f4c40003520 con 0x7f4c54073790 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 msgr2=0x7f4c54161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 0x7f4c54161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 >> v1:172.21.15.181:6789/0 conn(0x7f4c54073380 legacy=0x7f4c540700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c540c9150 con 0x7f4c54073790 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.417+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f4c4c0019f0 con 0x7f4c54073790 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 >> v1:172.21.15.42:6789/0 conn(0x7f4c54073790 legacy=0x7f4c540707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c40003c60 0x7f4c400040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 0x7f4c40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40004db0 0x7f4c40005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540c8e70 con 0x7f4c40004db0 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4000bc20 con 0x7f4c40003c60 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4000be20 con 0x7f4c5415b620 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40004db0 0x7f4c40005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c5259c640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c40003c60 0x7f4c400040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c51d9b640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 0x7f4c40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c52d9d640 1 -- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 msgr2=0x7f4c40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c5415b620 0x7f4c40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c52d9d640 1 -- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c40003c60 msgr2=0x7f4c400040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c40003c60 0x7f4c400040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.418+0000 7f4c52d9d640 1 -- 172.21.15.42:0/3943693525 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c40003520 con 0x7f4c40004db0 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.419+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40004db0 0x7f4c40005280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00a6e0 tx=0x7f4c40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d4be06f4be37d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.420+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00a330 con 0x7f4c40004db0 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.420+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c02f070 con 0x7f4c40004db0 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.420+0000 7f4c5159a640 1 -- 172.21.15.42:0/3943693525 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c02bb40 con 0x7f4c40004db0 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.421+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40004db0 msgr2=0x7f4c40005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.421+0000 7f4c58de8640 1 --2- 172.21.15.42:0/3943693525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40004db0 0x7f4c40005280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00a6e0 tx=0x7f4c40005830 comp rx=0 tx=0).stop 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.422+0000 7f4c52d9d640 1 -- 172.21.15.42:0/3943693525 reap_dead start 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.422+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 shutdown_connections 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.422+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 >> 172.21.15.42:0/3943693525 conn(0x7f4c5406cdc0 msgr2=0x7f4c540cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:19.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.422+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 shutdown_connections 2024-05-09T01:44:19.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.422+0000 7f4c58de8640 1 -- 172.21.15.42:0/3943693525 wait complete. 2024-05-09T01:44:19.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.424+0000 7f4c58de8640 1 Processor -- start 2024-05-09T01:44:19.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.424+0000 7f4c58de8640 1 -- start start 2024-05-09T01:44:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c58de8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c40004db0 0x7f4c541fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c58de8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c541f8460 0x7f4c5415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c58de8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 0x7f4c54155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c58de8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540c9c30 con 0x7f4c54154c40 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c58de8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540c9710 con 0x7f4c541f8460 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c58de8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4c540c9fb0 con 0x7f4c40004db0 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c52d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 0x7f4c54155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c52d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 0x7f4c54155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54766/0 (socket says 172.21.15.42:54766) 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c52d9d640 1 -- 172.21.15.42:0/562665402 learned_addr learned my addr 172.21.15.42:0/562665402 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c51d9b640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c541f8460 0x7f4c5415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c5259c640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c40004db0 0x7f4c541fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c52d9d640 1 -- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c40004db0 msgr2=0x7f4c541fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.426+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c40004db0 0x7f4c541fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c52d9d640 1 -- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c541f8460 msgr2=0x7f4c5415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c541f8460 0x7f4c5415d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c52d9d640 1 -- 172.21.15.42:0/562665402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5415d570 con 0x7f4c54154c40 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c51d9b640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c541f8460 0x7f4c5415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c52d9d640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 0x7f4c54155050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c02b2f0 tx=0x7f4c540c6650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00a330 con 0x7f4c54154c40 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c02ba80 con 0x7f4c54154c40 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c034470 con 0x7f4c54154c40 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c54155ac0 con 0x7f4c54154c40 2024-05-09T01:44:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.427+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c54156080 con 0x7f4c54154c40 2024-05-09T01:44:19.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.429+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c540c7960 con 0x7f4c54154c40 2024-05-09T01:44:19.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.429+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c4c034610 con 0x7f4c54154c40 2024-05-09T01:44:19.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.430+0000 7f4c4affd640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4c34076300 0x7f4c34078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.430+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4c4c0b71d0 con 0x7f4c54154c40 2024-05-09T01:44:19.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.431+0000 7f4c5259c640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4c34076300 0x7f4c34078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.432+0000 7f4c5259c640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4c34076300 0x7f4c34078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009990 tx=0x7f4c44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:19.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.437+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4c540c7960 con 0x7f4c54154c40 2024-05-09T01:44:19.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.779+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c540ca570 con 0x7f4c54154c40 2024-05-09T01:44:19.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.780+0000 7f4c4affd640 1 -- 172.21.15.42:0/562665402 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f4c4c080a20 con 0x7f4c54154c40 2024-05-09T01:44:19.778 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:44:19.778 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:44:19.779 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4c34076300 msgr2=0x7f4c34078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4c34076300 0x7f4c34078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009990 tx=0x7f4c44008040 comp rx=0 tx=0).stop 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 msgr2=0x7f4c54155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 0x7f4c54155050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c02b2f0 tx=0x7f4c540c6650 comp rx=0 tx=0).stop 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 shutdown_connections 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4c34076300 0x7f4c34078810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c54154c40 0x7f4c54155050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c541f8460 0x7f4c5415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 --2- 172.21.15.42:0/562665402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c40004db0 0x7f4c541fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 >> 172.21.15.42:0/562665402 conn(0x7f4c5406cdc0 msgr2=0x7f4c541583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 shutdown_connections 2024-05-09T01:44:19.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.784+0000 7f4c58de8640 1 -- 172.21.15.42:0/562665402 wait complete. 2024-05-09T01:44:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0' 2024-05-09T01:44:19.799 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0 2024-05-09T01:44:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.990+0000 7fefb711c640 1 Processor -- start 2024-05-09T01:44:19.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.990+0000 7fefb711c640 1 -- start start 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefb711c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fefb00cce30 0x7fefb00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefb711c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb015b480 0x7fefb016bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefb711c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb00cee90 con 0x7fefb00cd990 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefb711c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fefb0161c50 con 0x7fefb00cce30 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefb711c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fefb00cd240 con 0x7fefb015b480 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefaffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fefb00cce30 0x7fefb00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefaffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fefb00cce30 0x7fefb00c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54774/0 (socket says 172.21.15.42:54774) 2024-05-09T01:44:19.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.992+0000 7fefaffff640 1 -- 172.21.15.42:0/533200014 learned_addr learned my addr 172.21.15.42:0/533200014 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:19.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.993+0000 7fefb56b9640 1 --2- 172.21.15.42:0/533200014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb015b480 0x7fefb016bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.993+0000 7fefaffff640 1 -- 172.21.15.42:0/533200014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb015b480 msgr2=0x7fefb016bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.993+0000 7fefaffff640 1 --2- 172.21.15.42:0/533200014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb015b480 0x7fefb016bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.993+0000 7fefaffff640 1 -- 172.21.15.42:0/533200014 >> v1:172.21.15.181:6789/0 conn(0x7fefb00cd990 legacy=0x7fefb006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.993+0000 7fefaffff640 1 -- 172.21.15.42:0/533200014 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb0161e80 con 0x7fefb00cce30 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.994+0000 7fefaffff640 1 --2- 172.21.15.42:0/533200014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cce30 0x7fefb00c6b40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefb00727a0 tx=0x7fef9c02a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50370d575bbefaac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.994+0000 7fefaf7fe640 1 -- 172.21.15.42:0/533200014 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c037070 con 0x7fefb00cce30 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.994+0000 7fefaf7fe640 1 -- 172.21.15.42:0/533200014 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9c032440 con 0x7fefb00cce30 2024-05-09T01:44:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.994+0000 7fefaf7fe640 1 -- 172.21.15.42:0/533200014 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c032810 con 0x7fefb00cce30 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 -- 172.21.15.42:0/533200014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cce30 msgr2=0x7fefb00c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 --2- 172.21.15.42:0/533200014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cce30 0x7fefb00c6b40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefb00727a0 tx=0x7fef9c02a1b0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 -- 172.21.15.42:0/533200014 shutdown_connections 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 --2- 172.21.15.42:0/533200014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb015b480 0x7fefb016bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 --2- 172.21.15.42:0/533200014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cce30 0x7fefb00c6b40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 -- 172.21.15.42:0/533200014 >> 172.21.15.42:0/533200014 conn(0x7fefb00cb410 msgr2=0x7fefb00ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 -- 172.21.15.42:0/533200014 shutdown_connections 2024-05-09T01:44:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.995+0000 7fefb711c640 1 -- 172.21.15.42:0/533200014 wait complete. 2024-05-09T01:44:19.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.997+0000 7fefb711c640 1 Processor -- start 2024-05-09T01:44:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.997+0000 7fefb711c640 1 -- start start 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefb711c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb00cce30 0x7fefb01fb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefb711c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 0x7fefb015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefb711c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb015b480 0x7fefb0150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefb711c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefb00cc350 con 0x7fefb00cd990 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefb711c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fefb00cc070 con 0x7fefb015b480 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefb711c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fefb00cc630 con 0x7fefb00cce30 2024-05-09T01:44:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefaffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 0x7fefb015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefaffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 0x7fefb015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54778/0 (socket says 172.21.15.42:54778) 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:19.999+0000 7fefaffff640 1 -- 172.21.15.42:0/3901576222 learned_addr learned my addr 172.21.15.42:0/3901576222 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb00cce30 0x7fefb01fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefb56b9640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb015b480 0x7fefb0150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefaffff640 1 -- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb00cce30 msgr2=0x7fefb01fb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefaffff640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb00cce30 0x7fefb01fb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefaffff640 1 -- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb015b480 msgr2=0x7fefb0150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefaffff640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb015b480 0x7fefb0150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefaffff640 1 -- 172.21.15.42:0/3901576222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb01fb650 con 0x7fefb00cd990 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefaffff640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 0x7fefb015d020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef9c000c00 tx=0x7fef9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefad7fa640 1 -- 172.21.15.42:0/3901576222 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c041070 con 0x7fefb00cd990 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefad7fa640 1 -- 172.21.15.42:0/3901576222 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9c03c870 con 0x7fefb00cd990 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb015dba0 con 0x7fefb00cd990 2024-05-09T01:44:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefad7fa640 1 -- 172.21.15.42:0/3901576222 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c037040 con 0x7fefb00cd990 2024-05-09T01:44:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.000+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb015e160 con 0x7fefb00cd990 2024-05-09T01:44:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.003+0000 7fefad7fa640 1 -- 172.21.15.42:0/3901576222 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef9c044070 con 0x7fefb00cd990 2024-05-09T01:44:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.004+0000 7fefad7fa640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fef94076300 0x7fef94078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.004+0000 7fefad7fa640 1 -- 172.21.15.42:0/3901576222 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fef9c0b8100 con 0x7fefb00cd990 2024-05-09T01:44:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.004+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fef94076300 0x7fef94078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.005+0000 7fefbdfcc740 1 Processor -- start 2024-05-09T01:44:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.005+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fef94076300 0x7fef94078810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fefa4006fd0 tx=0x7fefa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.006+0000 7fefbdfcc740 1 -- start start 2024-05-09T01:44:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36023ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3601df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed3601e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed35f86930 con 0x55ed35c7e910 2024-05-09T01:44:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ed35f22890 con 0x55ed35c55a50 2024-05-09T01:44:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ed35f828f0 con 0x55ed35c5dc30 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.007+0000 7fefb4eb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36023ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36023ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54784/0 (socket says 172.21.15.42:54784) 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 -- 172.21.15.42:0/3065473351 learned_addr learned my addr 172.21.15.42:0/3065473351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefaffff640 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3601df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb56b9640 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed3601e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 -- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 msgr2=0x55ed3601e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed3601e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 -- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 msgr2=0x55ed3601df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3601df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 -- 172.21.15.42:0/3065473351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed35d60d50 con 0x55ed35c7e910 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36023ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fefa400d860 tx=0x7fefa4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef149dcca8cc875 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.008+0000 7fef9a7fc640 1 -- 172.21.15.42:0/3065473351 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004020 con 0x55ed35c7e910 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.009+0000 7fef9a7fc640 1 -- 172.21.15.42:0/3065473351 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa40041c0 con 0x55ed35c7e910 2024-05-09T01:44:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.009+0000 7fef9a7fc640 1 -- 172.21.15.42:0/3065473351 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa40149b0 con 0x55ed35c7e910 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 -- 172.21.15.42:0/3065473351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 msgr2=0x55ed36023ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36023ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fefa400d860 tx=0x7fefa4010000 comp rx=0 tx=0).stop 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 -- 172.21.15.42:0/3065473351 shutdown_connections 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed3601e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3601df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/3065473351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36023ca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 -- 172.21.15.42:0/3065473351 >> 172.21.15.42:0/3065473351 conn(0x55ed35c72a60 msgr2=0x55ed36022440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.010+0000 7fefbdfcc740 1 -- 172.21.15.42:0/3065473351 shutdown_connections 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.011+0000 7fefbdfcc740 1 -- 172.21.15.42:0/3065473351 wait complete. 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.012+0000 7fefbdfcc740 1 -- start start 2024-05-09T01:44:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.012+0000 7fefbdfcc740 1 Processor -- start 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.014+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed36040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.014+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.014+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36046ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed360623c0 con 0x55ed35c7e910 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ed35f0d700 con 0x55ed35c55a50 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ed360222a0 con 0x55ed35c5dc30 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefaffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed36040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed36040fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:47248/0 (socket says 172.21.15.42:47248) 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefaffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:43946/0 (socket says 172.21.15.42:43946) 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1660876591 learned_addr learned my addr 172.21.15.42:0/1660876591 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefbdfcc740 10 client.0 _ll_register_callbacks cb 0x55ed35f43380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb56b9640 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36046ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 msgr2=0x55ed360467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1660876591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 msgr2=0x55ed36046ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36046ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1660876591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed35dc5540 con 0x55ed35c55a50 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed36040fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fefa4021040 tx=0x7fefa4004680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831281b7dbbcb788 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.015+0000 7fef8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.016+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1660876591 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa402e070 con 0x55ed35c55a50 2024-05-09T01:44:20.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.016+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1660876591 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fefa40035f0 con 0x55ed35c55a50 2024-05-09T01:44:20.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.016+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa40041c0 con 0x55ed35c55a50 2024-05-09T01:44:20.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.016+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1660876591 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fefa4039050 con 0x55ed35c55a50 2024-05-09T01:44:20.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.016+0000 7fefbdfcc740 10 client.4912 fetch_fsmap learned FSMap version 16 2024-05-09T01:44:20.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.016+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55ed35d67a50 con 0x55ed35c55a50 2024-05-09T01:44:20.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1660876591 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa40041c0 con 0x55ed35c55a50 2024-05-09T01:44:20.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1660876591 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fefa403c020 con 0x55ed35c55a50 2024-05-09T01:44:20.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fefbdfcc740 10 client.4912 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:44:20.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fefbdfcc740 10 client.4912 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:44:20.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fefbdfcc740 20 client.4912 populate_metadata read hostname 'smithi042' 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed35c3d6f0 0x55ed3603efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fefbdfcc740 4 client.4912 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.017+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed35f94540 con 0x55ed35c3d6f0 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.018+0000 7fefaffff640 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed35c3d6f0 0x55ed3603efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.018+0000 7fef8f7fe640 10 client.4912 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.018+0000 7fefaffff640 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed35c3d6f0 0x55ed3603efb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38d4a2533cc6b4d server_cookie=2ac96eca71ec5539 in_seq=0 out_seq=0 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1660876591 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ed35f94540 con 0x55ed35c3d6f0 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fef8f7fe640 10 client.4912 handle_command_reply: tid=0 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 client.4912 shutdown 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 msgr2=0x55ed36040fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed36040fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fefa4021040 tx=0x7fefa4004680 comp rx=0 tx=0).stop 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 shutdown_connections 2024-05-09T01:44:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed35c3d6f0 0x55ed3603efb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed36046ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1660876591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed36040fe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 >> 172.21.15.42:0/1660876591 conn(0x55ed35c72a60 msgr2=0x55ed360212e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.019+0000 7fef8f7fe640 0 client.4912 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.020+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 shutdown_connections 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.020+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1660876591 wait complete. 2024-05-09T01:44:20.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.020+0000 7fefbdfcc740 20 client.4912 trim_cache size 0 max 16384 2024-05-09T01:44:20.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.047+0000 7fefbdfcc740 1 Processor -- start 2024-05-09T01:44:20.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.047+0000 7fefbdfcc740 1 -- start start 2024-05-09T01:44:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.049+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 0x55ed360880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.049+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c5dc30 0x55ed3601df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.049+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed3601e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.049+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0204c50 con 0x55ed35c7e910 2024-05-09T01:44:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.049+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fefb00c9370 con 0x55ed35c5dc30 2024-05-09T01:44:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.049+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fefb0204580 con 0x55ed35c55a50 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 0x55ed360880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefaffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c5dc30 0x55ed3601df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 0x55ed360880a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:43962/0 (socket says 172.21.15.42:43962) 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1593301662 learned_addr learned my addr 172.21.15.42:0/1593301662 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb56b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed3601e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c5dc30 msgr2=0x55ed3601df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c5dc30 0x55ed3601df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1593301662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 msgr2=0x55ed3601e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed3601e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 -- 172.21.15.42:0/1593301662 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed360612e0 con 0x55ed35c55a50 2024-05-09T01:44:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefaffff640 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c5dc30 0x55ed3601df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:44:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb56b9640 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed3601e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:44:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.050+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 0x55ed360880a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefa40039b0 tx=0x7fefa4027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4403a95d08bad83f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.051+0000 7fef99ffb640 1 -- 172.21.15.42:0/1593301662 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa402e040 con 0x55ed35c55a50 2024-05-09T01:44:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.051+0000 7fef99ffb640 1 -- 172.21.15.42:0/1593301662 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa4014800 con 0x55ed35c55a50 2024-05-09T01:44:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.051+0000 7fef99ffb640 1 -- 172.21.15.42:0/1593301662 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa40042f0 con 0x55ed35c55a50 2024-05-09T01:44:20.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 msgr2=0x55ed360880a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:20.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 0x55ed360880a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefa40039b0 tx=0x7fefa4027000 comp rx=0 tx=0).stop 2024-05-09T01:44:20.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1593301662 shutdown_connections 2024-05-09T01:44:20.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed3601e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c5dc30 0x55ed3601df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1593301662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c55a50 0x55ed360880a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1593301662 >> 172.21.15.42:0/1593301662 conn(0x55ed35c72a60 msgr2=0x55ed36023c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1593301662 shutdown_connections 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.053+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1593301662 wait complete. 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.054+0000 7fefbdfcc740 1 -- start start 2024-05-09T01:44:20.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.055+0000 7fefbdfcc740 1 Processor -- start 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3604ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed360da390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0203eb0 con 0x55ed35c7e910 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fefb02037e0 con 0x55ed35c55a50 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fefb0157e90 con 0x55ed35c5dc30 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.056+0000 7fefbdfcc740 10 client.0 _ll_register_callbacks cb 0x7fefa4004020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:44:20.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed360da390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed360da390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54818/0 (socket says 172.21.15.42:54818) 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 -- 172.21.15.42:0/1962341805 learned_addr learned my addr 172.21.15.42:0/1962341805 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefaffff640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3604ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 -- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 msgr2=0x55ed360216e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360216e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 -- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 msgr2=0x55ed3604ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3604ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 -- 172.21.15.42:0/1962341805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed3603fba0 con 0x55ed35c7e910 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fefb56b9640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed360da390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefb006eb10 tx=0x7fefa8015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc712351ddc9fa30 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.057+0000 7fef8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1962341805 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8023480 con 0x55ed35c7e910 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1962341805 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fefa8023620 con 0x55ed35c7e910 2024-05-09T01:44:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa4014800 con 0x55ed35c7e910 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1962341805 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fefa8023820 con 0x55ed35c7e910 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fefbdfcc740 10 client.5016 fetch_fsmap learned FSMap version 16 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55ed36049550 con 0x55ed35c7e910 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1962341805 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa4014800 con 0x55ed35c7e910 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1962341805 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fefa802f080 con 0x55ed35c7e910 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fefbdfcc740 10 client.5016 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fefbdfcc740 10 client.5016 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.058+0000 7fefbdfcc740 20 client.5016 populate_metadata read hostname 'smithi042' 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.059+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed360da8d0 0x55ed3601caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.059+0000 7fefbdfcc740 4 client.5016 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}] 2024-05-09T01:44:20.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.059+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}) -- 0x55ed35f8e3b0 con 0x55ed360da8d0 2024-05-09T01:44:20.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.059+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed360da8d0 0x55ed3601caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:20.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.060+0000 7fefb4eb8640 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed360da8d0 0x55ed3601caa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c333bd9ce6ff3d74 server_cookie=3efc9d5a798b8f91 in_seq=0 out_seq=0 2024-05-09T01:44:20.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.060+0000 7fef8f7fe640 10 client.5016 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:20.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fef8f7fe640 1 -- 172.21.15.42:0/1962341805 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ed35f8e3b0 con 0x55ed360da8d0 2024-05-09T01:44:20.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fef8f7fe640 10 client.5016 handle_command_reply: tid=0 2024-05-09T01:44:20.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 client.5016 shutdown 2024-05-09T01:44:20.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 msgr2=0x55ed360da390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed360da390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefb006eb10 tx=0x7fefa8015700 comp rx=0 tx=0).stop 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 shutdown_connections 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x55ed360da8d0 0x55ed3601caa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed35c7e910 0x55ed360da390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ed35c5dc30 0x55ed360216e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 --2- 172.21.15.42:0/1962341805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed35c55a50 0x55ed3604ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fef8f7fe640 0 client.5016 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 >> 172.21.15.42:0/1962341805 conn(0x55ed35c72a60 msgr2=0x55ed36023a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 shutdown_connections 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 1 -- 172.21.15.42:0/1962341805 wait complete. 2024-05-09T01:44:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.071+0000 7fefbdfcc740 20 client.5016 trim_cache size 0 max 16384 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 10, 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "2c5466f4": { 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 10, 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-05-09T01:44:20.071 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 139.4, 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:20.072 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fef94076300 msgr2=0x7fef94078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fef94076300 0x7fef94078810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fefa4006fd0 tx=0x7fefa4008040 comp rx=0 tx=0).stop 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 msgr2=0x7fefb015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 0x7fefb015d020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef9c000c00 tx=0x7fef9c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 shutdown_connections 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fef94076300 0x7fef94078810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb015b480 0x7fefb0150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefb00cd990 0x7fefb015d020 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 --2- 172.21.15.42:0/3901576222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb00cce30 0x7fefb01fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 >> 172.21.15.42:0/3901576222 conn(0x7fefb00cb410 msgr2=0x7fefb00c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 shutdown_connections 2024-05-09T01:44:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:20.072+0000 7fefb711c640 1 -- 172.21.15.42:0/3901576222 wait complete. 2024-05-09T01:44:20.081 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2c5466f4', quiesce took 0.8 seconds. Will release after: 18.599999999999998 2024-05-09T01:44:32.068 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:44:32.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:44:38.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:44:38.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.813+0000 7fafd0ec8640 1 Processor -- start 2024-05-09T01:44:38.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.814+0000 7fafd0ec8640 1 -- start start 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafd0ec8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fafcc0c9500 0x7fafcc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafd0ec8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc1570f0 0x7fafcc0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafd0ec8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafcc160420 con 0x7fafcc0b7ba0 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafd0ec8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fafcc1612f0 con 0x7fafcc0c9500 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafd0ec8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fafcc0cc350 con 0x7fafcc1570f0 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafca59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fafcc0c9500 0x7fafcc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafca59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fafcc0c9500 0x7fafcc0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53698/0 (socket says 172.21.15.42:53698) 2024-05-09T01:44:38.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafca59c640 1 -- 172.21.15.42:0/2648934419 learned_addr learned my addr 172.21.15.42:0/2648934419 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:38.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafcad9d640 1 --2- 172.21.15.42:0/2648934419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc1570f0 0x7fafcc0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:38.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafca59c640 1 -- 172.21.15.42:0/2648934419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc1570f0 msgr2=0x7fafcc0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:38.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.815+0000 7fafca59c640 1 --2- 172.21.15.42:0/2648934419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc1570f0 0x7fafcc0ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:38.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.816+0000 7fafca59c640 1 -- 172.21.15.42:0/2648934419 >> v1:172.21.15.181:6789/0 conn(0x7fafcc0b7ba0 legacy=0x7fafcc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:38.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.816+0000 7fafca59c640 1 -- 172.21.15.42:0/2648934419 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc1606e0 con 0x7fafcc0c9500 2024-05-09T01:44:38.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.816+0000 7fafca59c640 1 --2- 172.21.15.42:0/2648934419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc0c9500 0x7fafcc0ce4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009e50 tx=0x7fafbc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a0d4aceb525bec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.817+0000 7fafc959a640 1 -- 172.21.15.42:0/2648934419 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc036070 con 0x7fafcc0c9500 2024-05-09T01:44:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.817+0000 7fafc959a640 1 -- 172.21.15.42:0/2648934419 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc031600 con 0x7fafcc0c9500 2024-05-09T01:44:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.817+0000 7fafc959a640 1 -- 172.21.15.42:0/2648934419 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0319d0 con 0x7fafcc0c9500 2024-05-09T01:44:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.817+0000 7fafd0ec8640 1 -- 172.21.15.42:0/2648934419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc0c9500 msgr2=0x7fafcc0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.817+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/2648934419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc0c9500 0x7fafcc0ce4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009e50 tx=0x7fafbc02a680 comp rx=0 tx=0).stop 2024-05-09T01:44:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.818+0000 7fafd0ec8640 1 -- 172.21.15.42:0/2648934419 shutdown_connections 2024-05-09T01:44:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.818+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/2648934419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc1570f0 0x7fafcc0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.818+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/2648934419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc0c9500 0x7fafcc0ce4b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.818+0000 7fafd0ec8640 1 -- 172.21.15.42:0/2648934419 >> 172.21.15.42:0/2648934419 conn(0x7fafcc0d2100 msgr2=0x7fafcc0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.818+0000 7fafd0ec8640 1 -- 172.21.15.42:0/2648934419 shutdown_connections 2024-05-09T01:44:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.818+0000 7fafd0ec8640 1 -- 172.21.15.42:0/2648934419 wait complete. 2024-05-09T01:44:38.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.820+0000 7fafd0ec8640 1 Processor -- start 2024-05-09T01:44:38.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.820+0000 7fafd0ec8640 1 -- start start 2024-05-09T01:44:38.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafd0ec8640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc0b7ba0 0x7fafcc15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:38.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafd0ec8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafcc0c9500 0x7fafcc148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:38.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafd0ec8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 0x7fafcc1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:38.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafd0ec8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc160f80 con 0x7fafcc1570f0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafd0ec8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc160ca0 con 0x7fafcc0c9500 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafd0ec8640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fafcc157500 con 0x7fafcc0b7ba0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 0x7fafcc1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 0x7fafcc1f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53702/0 (socket says 172.21.15.42:53702) 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 -- 172.21.15.42:0/3882496499 learned_addr learned my addr 172.21.15.42:0/3882496499 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafca59c640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc0b7ba0 0x7fafcc15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafc9d9b640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafcc0c9500 0x7fafcc148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 -- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc0b7ba0 msgr2=0x7fafcc15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc0b7ba0 0x7fafcc15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 -- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafcc0c9500 msgr2=0x7fafcc148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafcc0c9500 0x7fafcc148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.821+0000 7fafcad9d640 1 -- 172.21.15.42:0/3882496499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc160120 con 0x7fafcc1570f0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.822+0000 7fafcad9d640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 0x7fafcc1f3070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fafc400c5f0 tx=0x7fafc400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.822+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4015070 con 0x7fafcc1570f0 2024-05-09T01:44:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.822+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc4004220 con 0x7fafcc1570f0 2024-05-09T01:44:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.822+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafcc158130 con 0x7fafcc1570f0 2024-05-09T01:44:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.822+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4003610 con 0x7fafcc1570f0 2024-05-09T01:44:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.822+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafcc1586b0 con 0x7fafcc1570f0 2024-05-09T01:44:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.823+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafcc158420 con 0x7fafcc1570f0 2024-05-09T01:44:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.824+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fafc40037b0 con 0x7fafcc1570f0 2024-05-09T01:44:38.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.824+0000 7fafbaffd640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fafac076300 0x7fafac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:38.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.824+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fafc4097330 con 0x7fafcc1570f0 2024-05-09T01:44:38.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.825+0000 7fafca59c640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fafac076300 0x7fafac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:38.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.825+0000 7fafca59c640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fafac076300 0x7fafac078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fafbc033000 tx=0x7fafbc009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:38.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:38.829+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fafc4060600 con 0x7fafcc1570f0 2024-05-09T01:44:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.063+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafcc156190 con 0x7fafcc1570f0 2024-05-09T01:44:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.064+0000 7fafbaffd640 1 -- 172.21.15.42:0/3882496499 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7fafc4064900 con 0x7fafcc1570f0 2024-05-09T01:44:39.062 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:44:39.062 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:44:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fafac076300 msgr2=0x7fafac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fafac076300 0x7fafac078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fafbc033000 tx=0x7fafbc009000 comp rx=0 tx=0).stop 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 msgr2=0x7fafcc1f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 0x7fafcc1f3070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fafc400c5f0 tx=0x7fafc400cab0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 shutdown_connections 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fafac076300 0x7fafac078810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafcc1570f0 0x7fafcc1f3070 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafcc0c9500 0x7fafcc148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 --2- 172.21.15.42:0/3882496499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafcc0b7ba0 0x7fafcc15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 >> 172.21.15.42:0/3882496499 conn(0x7fafcc0d2100 msgr2=0x7fafcc0c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 shutdown_connections 2024-05-09T01:44:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.066+0000 7fafd0ec8640 1 -- 172.21.15.42:0/3882496499 wait complete. 2024-05-09T01:44:39.075 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db --set-id 2c5466f4 --release --await' 2024-05-09T01:44:39.075 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db --set-id 2c5466f4 --release --await 2024-05-09T01:44:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.200+0000 7eff8f8e0640 1 Processor -- start 2024-05-09T01:44:39.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.200+0000 7eff8f8e0640 1 -- start start 2024-05-09T01:44:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8f8e0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff88154ef0 0x7eff8815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8f8e0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7eff880cb280 0x7eff880cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8f8e0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff880cca70 con 0x7eff880d0060 2024-05-09T01:44:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8f8e0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7eff880ccd50 con 0x7eff880cb280 2024-05-09T01:44:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8f8e0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7eff880cd030 con 0x7eff88154ef0 2024-05-09T01:44:39.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8ce7b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7eff880cb280 0x7eff880cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8de7d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7eff880d0060 0x7eff880c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:42838/0 (socket says 172.21.15.42:42838) 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.201+0000 7eff8de7d640 1 -- 172.21.15.42:0/2748794449 learned_addr learned my addr 172.21.15.42:0/2748794449 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2748794449 >> v2:172.21.15.181:3300/0 conn(0x7eff88154ef0 0x7eff8815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2748794449 >> v2:172.21.15.181:3300/0 conn(0x7eff88154ef0 msgr2=0x7eff8815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2748794449 >> v2:172.21.15.181:3300/0 conn(0x7eff88154ef0 0x7eff8815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2748794449 >> v1:172.21.15.42:6789/0 conn(0x7eff880d0060 legacy=0x7eff880c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2748794449 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff880cd310 con 0x7eff880cb280 2024-05-09T01:44:39.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2748794449 >> v2:172.21.15.181:3300/0 conn(0x7eff88154ef0 0x7eff8815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:44:39.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2748794449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880cb280 0x7eff880cb690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff880ca7b0 tx=0x7eff7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0048dfdb5fc8584 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.202+0000 7eff87fff640 1 -- 172.21.15.42:0/2748794449 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c037070 con 0x7eff880cb280 2024-05-09T01:44:39.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff87fff640 1 -- 172.21.15.42:0/2748794449 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c032440 con 0x7eff880cb280 2024-05-09T01:44:39.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff87fff640 1 -- 172.21.15.42:0/2748794449 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c032810 con 0x7eff880cb280 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2748794449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880cb280 msgr2=0x7eff880cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2748794449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880cb280 0x7eff880cb690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff880ca7b0 tx=0x7eff7c02a230 comp rx=0 tx=0).stop 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2748794449 shutdown_connections 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2748794449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880cb280 0x7eff880cb690 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2748794449 >> v2:172.21.15.181:3300/0 conn(0x7eff88154ef0 0x7eff8815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2748794449 >> 172.21.15.42:0/2748794449 conn(0x7eff88071310 msgr2=0x7eff880726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2748794449 shutdown_connections 2024-05-09T01:44:39.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.203+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2748794449 wait complete. 2024-05-09T01:44:39.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.205+0000 7eff8f8e0640 1 Processor -- start 2024-05-09T01:44:39.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.205+0000 7eff8f8e0640 1 -- start start 2024-05-09T01:44:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8f8e0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff880cb280 0x7eff88157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8f8e0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 0x7eff881470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8f8e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff88154ef0 0x7eff881448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8f8e0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff880c5c20 con 0x7eff880d0060 2024-05-09T01:44:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8f8e0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff880c5aa0 con 0x7eff88154ef0 2024-05-09T01:44:39.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8f8e0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7eff880d0470 con 0x7eff880cb280 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.206+0000 7eff8ce7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 0x7eff881470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 0x7eff881470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53726/0 (socket says 172.21.15.42:53726) 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2089298194 learned_addr learned my addr 172.21.15.42:0/2089298194 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff880cb280 0x7eff88157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8de7d640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff88154ef0 0x7eff881448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff880cb280 msgr2=0x7eff88157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff880cb280 0x7eff88157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff88154ef0 msgr2=0x7eff881448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff88154ef0 0x7eff881448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 -- 172.21.15.42:0/2089298194 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff88157da0 con 0x7eff880d0060 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 0x7eff881470a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009890 tx=0x7eff7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff85ffb640 1 -- 172.21.15.42:0/2089298194 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c037040 con 0x7eff880d0060 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff85ffb640 1 -- 172.21.15.42:0/2089298194 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c042070 con 0x7eff880d0060 2024-05-09T01:44:39.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff881562a0 con 0x7eff880d0060 2024-05-09T01:44:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.207+0000 7eff85ffb640 1 -- 172.21.15.42:0/2089298194 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c030a50 con 0x7eff880d0060 2024-05-09T01:44:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.208+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff88157060 con 0x7eff880d0060 2024-05-09T01:44:39.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.209+0000 7eff85ffb640 1 -- 172.21.15.42:0/2089298194 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff7c030bf0 con 0x7eff880d0060 2024-05-09T01:44:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.210+0000 7eff85ffb640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7eff74076300 0x7eff74078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.210+0000 7eff85ffb640 1 -- 172.21.15.42:0/2089298194 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7eff7c0b7f40 con 0x7eff880d0060 2024-05-09T01:44:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.210+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7eff74076300 0x7eff74078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.211+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7eff74076300 0x7eff74078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff7800f500 tx=0x7eff78007770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.211+0000 7eff96799740 1 Processor -- start 2024-05-09T01:44:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.211+0000 7eff96799740 1 -- start start 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c9493c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff96799740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9491fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c94536be0 0x556c94920430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff96799740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556c9485f890 con 0x556c9452ea00 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556c947fb620 con 0x556c945578c0 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556c9485b850 con 0x556c94536be0 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff8ce7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9491fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff8ce7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9491fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53738/0 (socket says 172.21.15.42:53738) 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff8ce7b640 1 -- 172.21.15.42:0/1233929552 learned_addr learned my addr 172.21.15.42:0/1233929552 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.212+0000 7eff8d67c640 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c9493c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8de7d640 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c94536be0 0x556c94920430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8ce7b640 1 -- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c94536be0 msgr2=0x556c94920430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c94536be0 0x556c94920430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8ce7b640 1 -- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 msgr2=0x556c9493c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c9493c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8ce7b640 1 -- 172.21.15.42:0/1233929552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c94826a70 con 0x556c9452ea00 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9491fef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff7c07d1b0 tx=0x7eff7c07d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4169ee7a1f60b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff6effd640 1 -- 172.21.15.42:0/1233929552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c081130 con 0x556c9452ea00 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff6effd640 1 -- 172.21.15.42:0/1233929552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c085430 con 0x556c9452ea00 2024-05-09T01:44:39.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.213+0000 7eff6effd640 1 -- 172.21.15.42:0/1233929552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c089e50 con 0x556c9452ea00 2024-05-09T01:44:39.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 -- 172.21.15.42:0/1233929552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 msgr2=0x556c9491fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9491fef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff7c07d1b0 tx=0x7eff7c07d8b0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 -- 172.21.15.42:0/1233929552 shutdown_connections 2024-05-09T01:44:39.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c94536be0 0x556c94920430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9491fef0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 --2- 172.21.15.42:0/1233929552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c9493c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 -- 172.21.15.42:0/1233929552 >> 172.21.15.42:0/1233929552 conn(0x556c9454ba10 msgr2=0x556c948fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 -- 172.21.15.42:0/1233929552 shutdown_connections 2024-05-09T01:44:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.214+0000 7eff96799740 1 -- 172.21.15.42:0/1233929552 wait complete. 2024-05-09T01:44:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.215+0000 7eff96799740 1 -- start start 2024-05-09T01:44:39.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.215+0000 7eff96799740 1 Processor -- start 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9493f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94921bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c9491fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556c948fa350 con 0x556c9452ea00 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556c947e7330 con 0x556c94536be0 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556c9485f890 con 0x556c945578c0 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff96799740 10 client.0 _ll_register_callbacks cb 0x556c947e2be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:44:39.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff8d67c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9493f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff8d67c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9493f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53750/0 (socket says 172.21.15.42:53750) 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.216+0000 7eff8d67c640 1 -- 172.21.15.42:0/795832176 learned_addr learned my addr 172.21.15.42:0/795832176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94921bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8de7d640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c9491fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8d67c640 1 -- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 msgr2=0x556c9491fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8d67c640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c9491fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8d67c640 1 -- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 msgr2=0x556c94921bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8d67c640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94921bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8d67c640 1 -- 172.21.15.42:0/795832176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c945c2ea0 con 0x556c9452ea00 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8de7d640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c9491fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff8d67c640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9493f940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff7800df00 tx=0x7eff78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed62c3a528adc254 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff67fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff67fff640 1 -- 172.21.15.42:0/795832176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78029060 con 0x556c9452ea00 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff67fff640 1 -- 172.21.15.42:0/795832176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7eff7801bbe0 con 0x556c9452ea00 2024-05-09T01:44:39.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff7c085430 con 0x556c9452ea00 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff67fff640 1 -- 172.21.15.42:0/795832176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7eff7802f050 con 0x556c9452ea00 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff96799740 10 client.5037 fetch_fsmap learned FSMap version 16 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x556c94639d00 con 0x556c9452ea00 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.217+0000 7eff67fff640 1 -- 172.21.15.42:0/795832176 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c085430 con 0x556c9452ea00 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff67fff640 1 -- 172.21.15.42:0/795832176 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7eff78032020 con 0x556c9452ea00 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff96799740 10 client.5037 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff96799740 10 client.5037 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff96799740 20 client.5037 populate_metadata read hostname 'smithi042' 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff96799740 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c94516490 0x556c9494ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff96799740 4 client.5037 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:44:39.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c9486d2e0 con 0x556c94516490 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c94516490 0x556c9494ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c94516490 0x556c9494ed30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be387c73e40625d7 server_cookie=59db34c8a5617fdf in_seq=0 out_seq=0 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.218+0000 7eff67fff640 10 client.5037 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff67fff640 1 -- 172.21.15.42:0/795832176 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c9486d2e0 con 0x556c94516490 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff67fff640 10 client.5037 handle_command_reply: tid=0 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 client.5037 shutdown 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 msgr2=0x556c9493f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9493f940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff7800df00 tx=0x7eff78004ab0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 shutdown_connections 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c94516490 0x556c9494ed30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c9491fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94921bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff67fff640 0 client.5037 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:39.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 --2- 172.21.15.42:0/795832176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c9493f940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 >> 172.21.15.42:0/795832176 conn(0x556c9454ba10 msgr2=0x556c948fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 shutdown_connections 2024-05-09T01:44:39.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.219+0000 7eff96799740 1 -- 172.21.15.42:0/795832176 wait complete. 2024-05-09T01:44:39.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.220+0000 7eff96799740 20 client.5037 trim_cache size 0 max 16384 2024-05-09T01:44:39.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.238+0000 7eff96799740 1 Processor -- start 2024-05-09T01:44:39.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.238+0000 7eff96799740 1 -- start start 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff96799740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c94943f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94944440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c948fc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff96799740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff881fe670 con 0x556c9452ea00 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff881fcb30 con 0x556c94536be0 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7eff881fdfa0 con 0x556c945578c0 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c94943f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c94943f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53752/0 (socket says 172.21.15.42:53752) 2024-05-09T01:44:39.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 -- 172.21.15.42:0/2681012529 learned_addr learned my addr 172.21.15.42:0/2681012529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94944440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8de7d640 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c948fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 -- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 msgr2=0x556c948fc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c948fc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 -- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 msgr2=0x556c94944440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94944440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8d67c640 1 -- 172.21.15.42:0/2681012529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c94935d90 con 0x556c9452ea00 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.239+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94944440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff8d67c640 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c94943f00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7eff780243e0 tx=0x7eff78020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc15f5c61b4b81f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff6e7fc640 1 -- 172.21.15.42:0/2681012529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78037070 con 0x556c9452ea00 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff6e7fc640 1 -- 172.21.15.42:0/2681012529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7800db60 con 0x556c9452ea00 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff6e7fc640 1 -- 172.21.15.42:0/2681012529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78024860 con 0x556c9452ea00 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 -- 172.21.15.42:0/2681012529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 msgr2=0x556c94943f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c94943f00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7eff780243e0 tx=0x7eff78020000 comp rx=0 tx=0).stop 2024-05-09T01:44:39.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 -- 172.21.15.42:0/2681012529 shutdown_connections 2024-05-09T01:44:39.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c945578c0 0x556c948fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c94536be0 0x556c94944440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 --2- 172.21.15.42:0/2681012529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c9452ea00 0x556c94943f00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 -- 172.21.15.42:0/2681012529 >> 172.21.15.42:0/2681012529 conn(0x556c9454ba10 msgr2=0x556c9493c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 -- 172.21.15.42:0/2681012529 shutdown_connections 2024-05-09T01:44:39.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.240+0000 7eff96799740 1 -- 172.21.15.42:0/2681012529 wait complete. 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.241+0000 7eff96799740 1 -- start start 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.241+0000 7eff96799740 1 Processor -- start 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c9452ea00 0x556c9491c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 0x556c948f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c949b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff881fd8d0 con 0x556c94536be0 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff881fd200 con 0x556c945578c0 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7eff881f4c30 con 0x556c9452ea00 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 10 client.0 _ll_register_callbacks cb 0x7eff78007d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 0x556c948f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 0x556c948f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53754/0 (socket says 172.21.15.42:53754) 2024-05-09T01:44:39.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 -- 172.21.15.42:0/585737374 learned_addr learned my addr 172.21.15.42:0/585737374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8de7d640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c949b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8d67c640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c9452ea00 0x556c9491c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 -- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c9452ea00 msgr2=0x556c9491c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c9452ea00 0x556c9491c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 -- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 msgr2=0x556c949b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c949b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 -- 172.21.15.42:0/585737374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c94936610 con 0x556c94536be0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff8ce7b640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 0x556c948f5540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7eff7c07d1b0 tx=0x7eff7c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a95f8be8da51824 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff67fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff67fff640 1 -- 172.21.15.42:0/585737374 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c07d780 con 0x556c94536be0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff67fff640 1 -- 172.21.15.42:0/585737374 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7eff7c081390 con 0x556c94536be0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.243+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff7800db60 con 0x556c94536be0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff67fff640 1 -- 172.21.15.42:0/585737374 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7eff7c085430 con 0x556c94536be0 2024-05-09T01:44:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 10 client.5043 fetch_fsmap learned FSMap version 16 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x556c949bbed0 con 0x556c94536be0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff67fff640 1 -- 172.21.15.42:0/585737374 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c08d070 con 0x556c94536be0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff67fff640 1 -- 172.21.15.42:0/585737374 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7eff7c03a030 con 0x556c94536be0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 10 client.5043 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 10 client.5043 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 20 client.5043 populate_metadata read hostname 'smithi042' 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c9495e9d0 0x556c949b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 4 client.5043 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2c5466f4", "release": true, "await": true}] 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2c5466f4", "release": true, "await": true}) -- 0x556c94867310 con 0x556c9495e9d0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.244+0000 7eff8d67c640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c9495e9d0 0x556c949b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.245+0000 7eff67fff640 10 client.5043 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.245+0000 7eff8d67c640 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c9495e9d0 0x556c949b2020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5de5fb63d458a88 server_cookie=934a7c63b13141e3 in_seq=0 out_seq=0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.246+0000 7eff67fff640 1 -- 172.21.15.42:0/585737374 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x556c94867310 con 0x556c9495e9d0 2024-05-09T01:44:39.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.246+0000 7eff67fff640 10 client.5043 handle_command_reply: tid=0 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.246+0000 7eff96799740 1 client.5043 shutdown 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 msgr2=0x556c948f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 0x556c948f5540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7eff7c07d1b0 tx=0x7eff7c048000 comp rx=0 tx=0).stop 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 shutdown_connections 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x556c9495e9d0 0x556c949b2020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c945578c0 0x556c949b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556c94536be0 0x556c948f5540 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 --2- 172.21.15.42:0/585737374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556c9452ea00 0x556c9491c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 >> 172.21.15.42:0/585737374 conn(0x556c9454ba10 msgr2=0x556c9493c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff67fff640 0 client.5043 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 shutdown_connections 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 1 -- 172.21.15.42:0/585737374 wait complete. 2024-05-09T01:44:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.247+0000 7eff96799740 20 client.5043 trim_cache size 0 max 16384 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 12, 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "2c5466f4": { 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 12, 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:44:39.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 139.4, 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-09T01:44:39.250 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:44:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7eff74076300 msgr2=0x7eff74078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7eff74076300 0x7eff74078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff7800f500 tx=0x7eff78007770 comp rx=0 tx=0).stop 2024-05-09T01:44:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 msgr2=0x7eff881470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:44:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 0x7eff881470a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009890 tx=0x7eff7c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 shutdown_connections 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7eff74076300 0x7eff74078810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff88154ef0 0x7eff881448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff880d0060 0x7eff881470a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 --2- 172.21.15.42:0/2089298194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff880cb280 0x7eff88157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 >> 172.21.15.42:0/2089298194 conn(0x7eff88071310 msgr2=0x7eff88147d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 shutdown_connections 2024-05-09T01:44:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:44:39.248+0000 7eff8f8e0640 1 -- 172.21.15.42:0/2089298194 wait complete. 2024-05-09T01:44:39.259 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2c5466f4', total seconds elapsed: 20.0 2024-05-09T01:44:42.074 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:42.075 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 initial writers = 299690.03 kB/sec 2024-05-09T01:44:42.075 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 initial writers = 299688.30 kB/sec 2024-05-09T01:44:42.075 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 299690.03 kB/sec 2024-05-09T01:44:42.075 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 299690.03 kB/sec 2024-05-09T01:44:42.075 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 299690.03 kB/sec 2024-05-09T01:44:42.075 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 10485760.00 kB 2024-05-09T01:44:57.785 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:44:57.785 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 rewriters = 811932.88 kB/sec 2024-05-09T01:44:57.786 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 rewriters = 811914.08 kB/sec 2024-05-09T01:44:57.786 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 811932.88 kB/sec 2024-05-09T01:44:57.786 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 811932.88 kB/sec 2024-05-09T01:44:57.786 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 811932.88 kB/sec 2024-05-09T01:44:57.786 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 10485760.00 kB 2024-05-09T01:45:02.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:02.415 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:02.681 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:45:02.681 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 readers = 8944298.00 kB/sec 2024-05-09T01:45:02.681 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 readers = 8942125.43 kB/sec 2024-05-09T01:45:02.681 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 8944298.00 kB/sec 2024-05-09T01:45:02.681 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 8944298.00 kB/sec 2024-05-09T01:45:02.681 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 8944298.00 kB/sec 2024-05-09T01:45:02.682 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 10485760.00 kB 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: Children see throughput for 1 re-readers = 9019521.00 kB/sec 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: Parent sees throughput for 1 re-readers = 9017812.53 kB/sec 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: Min throughput per process = 9019521.00 kB/sec 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: Max throughput per process = 9019521.00 kB/sec 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: Avg throughput per process = 9019521.00 kB/sec 2024-05-09T01:45:05.922 INFO:tasks.workunit.client.0.smithi042.stdout: Min xfer = 10485760.00 kB 2024-05-09T01:45:12.715 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:45:12.716 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:45:12.716 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-05-09T01:45:12.716 INFO:tasks.workunit.client.0.smithi042.stdout:iozone test complete. 2024-05-09T01:45:12.718 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T01:45:12.718 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T01:45:12.759 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-09T01:45:12.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T01:45:13.105 DEBUG:teuthology.parallel:result is None 2024-05-09T01:45:13.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T01:45:13.140 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T01:45:13.140 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-09T01:45:13.149 INFO:tasks.quiescer:joining Quiescers 2024-05-09T01:45:13.150 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-09T01:45:13.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:45:13.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.298+0000 7fb745425640 1 Processor -- start 2024-05-09T01:45:13.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.298+0000 7fb745425640 1 -- start start 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.299+0000 7fb745425640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb7400ca870 0x7fb740151530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.299+0000 7fb745425640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb74015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb745425640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb74015c520 0x7fb74015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb745425640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb7400c57c0 con 0x7fb74015c520 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb745425640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb7400c5fd0 con 0x7fb7400ca870 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb745425640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7400c5a10 con 0x7fb740071c60 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb74015c520 0x7fb74015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb74015c520 0x7fb74015e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45090/0 (socket says 172.21.15.42:45090) 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 -- 172.21.15.42:0/2141862572 learned_addr learned my addr 172.21.15.42:0/2141862572 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73effd640 1 --2- 172.21.15.42:0/2141862572 >> v2:172.21.15.181:3300/0 conn(0x7fb7400ca870 0x7fb740151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73e7fc640 1 --2- 172.21.15.42:0/2141862572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb74015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 -- 172.21.15.42:0/2141862572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 msgr2=0x7fb74015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 --2- 172.21.15.42:0/2141862572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb74015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 -- 172.21.15.42:0/2141862572 >> v2:172.21.15.181:3300/0 conn(0x7fb7400ca870 msgr2=0x7fb740151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 --2- 172.21.15.42:0/2141862572 >> v2:172.21.15.181:3300/0 conn(0x7fb7400ca870 0x7fb740151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.300+0000 7fb73f7fe640 1 -- 172.21.15.42:0/2141862572 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7400c5cf0 con 0x7fb74015c520 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.301+0000 7fb73f7fe640 1 --2- 172.21.15.42:0/2141862572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb74015e0e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb740074210 tx=0x7fb73802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52d2306d7fc3097 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.301+0000 7fb73dffb640 1 -- 172.21.15.42:0/2141862572 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738037070 con 0x7fb74015c520 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.301+0000 7fb73dffb640 1 -- 172.21.15.42:0/2141862572 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb738032440 con 0x7fb74015c520 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.301+0000 7fb73dffb640 1 -- 172.21.15.42:0/2141862572 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738032810 con 0x7fb74015c520 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 -- 172.21.15.42:0/2141862572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 msgr2=0x7fb74015e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 --2- 172.21.15.42:0/2141862572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb74015e0e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb740074210 tx=0x7fb73802a140 comp rx=0 tx=0).stop 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 -- 172.21.15.42:0/2141862572 shutdown_connections 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 --2- 172.21.15.42:0/2141862572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb74015e0e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 --2- 172.21.15.42:0/2141862572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb74015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 --2- 172.21.15.42:0/2141862572 >> v2:172.21.15.181:3300/0 conn(0x7fb7400ca870 0x7fb740151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 -- 172.21.15.42:0/2141862572 >> 172.21.15.42:0/2141862572 conn(0x7fb740072580 msgr2=0x7fb740072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 -- 172.21.15.42:0/2141862572 shutdown_connections 2024-05-09T01:45:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.302+0000 7fb745425640 1 -- 172.21.15.42:0/2141862572 wait complete. 2024-05-09T01:45:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.304+0000 7fb745425640 1 Processor -- start 2024-05-09T01:45:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.304+0000 7fb745425640 1 -- start start 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb745425640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb740151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb745425640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7400ca870 0x7fb740157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb745425640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb740157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb745425640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb7400cad40 con 0x7fb74015c520 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb745425640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb74015c930 con 0x7fb7400ca870 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb745425640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb74015e620 con 0x7fb740071c60 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb740157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb740157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45106/0 (socket says 172.21.15.42:45106) 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 -- 172.21.15.42:0/1174086415 learned_addr learned my addr 172.21.15.42:0/1174086415 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73e7fc640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7400ca870 0x7fb740157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73effd640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb740151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 -- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 msgr2=0x7fb740151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb740151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 -- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7400ca870 msgr2=0x7fb740157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7400ca870 0x7fb740157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.305+0000 7fb73f7fe640 1 -- 172.21.15.42:0/1174086415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb740152130 con 0x7fb74015c520 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.306+0000 7fb73f7fe640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb740157db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb73802a180 tx=0x7fb7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.306+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738037040 con 0x7fb74015c520 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.306+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb738042070 con 0x7fb74015c520 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.306+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7400cba70 con 0x7fb74015c520 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.306+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738030920 con 0x7fb74015c520 2024-05-09T01:45:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.306+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7400cd030 con 0x7fb74015c520 2024-05-09T01:45:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.307+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7400cd270 con 0x7fb74015c520 2024-05-09T01:45:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.308+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb738030ac0 con 0x7fb74015c520 2024-05-09T01:45:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.308+0000 7fb7377fe640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb7200762d0 0x7fb7200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.308+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb7380b8a10 con 0x7fb74015c520 2024-05-09T01:45:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.308+0000 7fb73effd640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb7200762d0 0x7fb7200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.309+0000 7fb73effd640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb7200762d0 0x7fb7200787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb7300099c0 tx=0x7fb730003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.312+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb738082340 con 0x7fb74015c520 2024-05-09T01:45:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.541+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7400d0d80 con 0x7fb74015c520 2024-05-09T01:45:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.541+0000 7fb7377fe640 1 -- 172.21.15.42:0/1174086415 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7fb7400d0d80 con 0x7fb74015c520 2024-05-09T01:45:13.539 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:13.539 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:45:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:45:13.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb7200762d0 msgr2=0x7fb7200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb7200762d0 0x7fb7200787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb7300099c0 tx=0x7fb730003990 comp rx=0 tx=0).stop 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 msgr2=0x7fb740157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb740157db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb73802a180 tx=0x7fb7380046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 shutdown_connections 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fb7200762d0 0x7fb7200787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb74015c520 0x7fb740157db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7400ca870 0x7fb740157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.543+0000 7fb745425640 1 --2- 172.21.15.42:0/1174086415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb740071c60 0x7fb740151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.544+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 >> 172.21.15.42:0/1174086415 conn(0x7fb740072580 msgr2=0x7fb740072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.544+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 shutdown_connections 2024-05-09T01:45:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.544+0000 7fb745425640 1 -- 172.21.15.42:0/1174086415 wait complete. 2024-05-09T01:45:13.553 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db --cancel --all' 2024-05-09T01:45:13.553 DEBUG:teuthology.orchestra.run.smithi042:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db --cancel --all 2024-05-09T01:45:13.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.675+0000 7f6b15e84640 1 Processor -- start 2024-05-09T01:45:13.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.675+0000 7f6b15e84640 1 -- start start 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.676+0000 7f6b15e84640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6b100c7780 0x7f6b100cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.676+0000 7f6b15e84640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6b101656f0 0x7f6b10167b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.676+0000 7f6b15e84640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1015cf90 con 0x7f6b100b4e90 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.676+0000 7f6b15e84640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100ce890 con 0x7f6b100c7780 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.676+0000 7f6b15e84640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100ccbc0 con 0x7f6b101656f0 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6b100c7780 0x7f6b100cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6b100c7780 0x7f6b100cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45118/0 (socket says 172.21.15.42:45118) 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/2480647558 learned_addr learned my addr 172.21.15.42:0/2480647558 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/2480647558 >> v2:172.21.15.181:3300/0 conn(0x7f6b101656f0 0x7f6b10167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/2480647558 >> v2:172.21.15.181:3300/0 conn(0x7f6b101656f0 msgr2=0x7f6b10167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/2480647558 >> v2:172.21.15.181:3300/0 conn(0x7f6b101656f0 0x7f6b10167b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/2480647558 >> v1:172.21.15.181:6789/0 conn(0x7f6b100b4e90 legacy=0x7f6b1006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/2480647558 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100cce10 con 0x7f6b100c7780 2024-05-09T01:45:13.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.677+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/2480647558 >> v2:172.21.15.181:3300/0 conn(0x7f6b101656f0 0x7f6b10167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:13.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/2480647558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b100c7780 0x7f6b100cd8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6b1015a950 tx=0x7f6b0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5e2f3579636d5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b0e7fc640 1 -- 172.21.15.42:0/2480647558 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00037070 con 0x7f6b100c7780 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b0e7fc640 1 -- 172.21.15.42:0/2480647558 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b00032440 con 0x7f6b100c7780 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b0e7fc640 1 -- 172.21.15.42:0/2480647558 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00032810 con 0x7f6b100c7780 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b15e84640 1 -- 172.21.15.42:0/2480647558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b100c7780 msgr2=0x7f6b100cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b15e84640 1 --2- 172.21.15.42:0/2480647558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b100c7780 0x7f6b100cd8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6b1015a950 tx=0x7f6b0002a140 comp rx=0 tx=0).stop 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b15e84640 1 -- 172.21.15.42:0/2480647558 shutdown_connections 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b15e84640 1 --2- 172.21.15.42:0/2480647558 >> v2:172.21.15.181:3300/0 conn(0x7f6b101656f0 0x7f6b10167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b15e84640 1 --2- 172.21.15.42:0/2480647558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b100c7780 0x7f6b100cd8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.678+0000 7f6b15e84640 1 -- 172.21.15.42:0/2480647558 >> 172.21.15.42:0/2480647558 conn(0x7f6b10068e00 msgr2=0x7f6b100d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.679+0000 7f6b15e84640 1 -- 172.21.15.42:0/2480647558 shutdown_connections 2024-05-09T01:45:13.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.679+0000 7f6b15e84640 1 -- 172.21.15.42:0/2480647558 wait complete. 2024-05-09T01:45:13.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.680+0000 7f6b15e84640 1 Processor -- start 2024-05-09T01:45:13.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.680+0000 7f6b15e84640 1 -- start start 2024-05-09T01:45:13.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b15e84640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b100b4e90 0x7f6b1015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b15e84640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b100c7780 0x7f6b10160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b15e84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 0x7f6b100cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b15e84640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100ce530 con 0x7f6b101656f0 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b15e84640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100cd460 con 0x7f6b100b4e90 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b15e84640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6b10157350 con 0x7f6b100c7780 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 0x7f6b100cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 0x7f6b100cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45128/0 (socket says 172.21.15.42:45128) 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 -- 172.21.15.42:0/3825270631 learned_addr learned my addr 172.21.15.42:0/3825270631 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b100b4e90 0x7f6b1015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0effd640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b100c7780 0x7f6b10160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 -- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b100c7780 msgr2=0x7f6b10160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b100c7780 0x7f6b10160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 -- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b100b4e90 msgr2=0x7f6b1015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b100b4e90 0x7f6b1015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 -- 172.21.15.42:0/3825270631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b10161030 con 0x7f6b101656f0 2024-05-09T01:45:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b100b4e90 0x7f6b1015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 0x7f6b100cbca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800cdb0 tx=0x7f6b0800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6af7fff640 1 -- 172.21.15.42:0/3825270631 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800f680 con 0x7f6b101656f0 2024-05-09T01:45:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.682+0000 7f6af7fff640 1 -- 172.21.15.42:0/3825270631 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0800f840 con 0x7f6b101656f0 2024-05-09T01:45:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.683+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b10069f10 con 0x7f6b101656f0 2024-05-09T01:45:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.683+0000 7f6af7fff640 1 -- 172.21.15.42:0/3825270631 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800fc30 con 0x7f6b101656f0 2024-05-09T01:45:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.683+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1015e700 con 0x7f6b101656f0 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.684+0000 7f6af7fff640 1 -- 172.21.15.42:0/3825270631 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b080213f0 con 0x7f6b101656f0 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.685+0000 7f6af7fff640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6afc076300 0x7f6afc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.685+0000 7f6af7fff640 1 -- 172.21.15.42:0/3825270631 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6b08098360 con 0x7f6b101656f0 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.685+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6afc076300 0x7f6afc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.686+0000 7f6b1ce10740 1 Processor -- start 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.686+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6afc076300 0x7f6afc078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b00034000 tx=0x7f6b0002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.686+0000 7f6b1ce10740 1 -- start start 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f80601340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563f80523600 con 0x563f8021b5b0 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563f804dd6e0 con 0x563f801f26f0 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563f8051f5c0 con 0x563f801fa8d0 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f80601340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f80601340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45132/0 (socket says 172.21.15.42:45132) 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/127079324 learned_addr learned my addr 172.21.15.42:0/127079324 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b0effd640 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.687+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 msgr2=0x563f805e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805e4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 msgr2=0x563f805e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/127079324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f80286b90 con 0x563f8021b5b0 2024-05-09T01:45:13.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:13.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f80601340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b000328f0 tx=0x7f6b0002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d170249cef7a31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6af57fa640 1 -- 172.21.15.42:0/127079324 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0004d070 con 0x563f8021b5b0 2024-05-09T01:45:13.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6af57fa640 1 -- 172.21.15.42:0/127079324 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0003c520 con 0x563f8021b5b0 2024-05-09T01:45:13.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.688+0000 7f6af57fa640 1 -- 172.21.15.42:0/127079324 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00037040 con 0x563f8021b5b0 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 -- 172.21.15.42:0/127079324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 msgr2=0x563f80601340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f80601340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b000328f0 tx=0x7f6b0002c000 comp rx=0 tx=0).stop 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 -- 172.21.15.42:0/127079324 shutdown_connections 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/127079324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f80601340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 -- 172.21.15.42:0/127079324 >> 172.21.15.42:0/127079324 conn(0x563f8020f700 msgr2=0x563f805bef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 -- 172.21.15.42:0/127079324 shutdown_connections 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.689+0000 7f6b1ce10740 1 -- 172.21.15.42:0/127079324 wait complete. 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.690+0000 7f6b1ce10740 1 -- start start 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.690+0000 7f6b1ce10740 1 Processor -- start 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80612eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80603f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563f805bedc0 con 0x563f801f26f0 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563f804ab060 con 0x563f8021b5b0 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563f805e1c00 con 0x563f801fa8d0 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b1ce10740 10 client.0 _ll_register_callbacks cb 0x563f804a6de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45144/0 (socket says 172.21.15.42:45144) 2024-05-09T01:45:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/1717432224 learned_addr learned my addr 172.21.15.42:0/1717432224 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80603f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.691+0000 7f6b0effd640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80612eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 msgr2=0x563f80612eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80612eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 msgr2=0x563f80603f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80603f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/1717432224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f802fd9f0 con 0x563f801f26f0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0effd640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80612eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f8ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009960 tx=0x7f6b00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99a338d6ef81128 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6aee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6aee7fc640 1 -- 172.21.15.42:0/1717432224 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00058060 con 0x563f801f26f0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b0003c520 con 0x563f801f26f0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6aee7fc640 1 -- 172.21.15.42:0/1717432224 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6b00048470 con 0x563f801f26f0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6aee7fc640 1 -- 172.21.15.42:0/1717432224 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6b0005e050 con 0x563f801f26f0 2024-05-09T01:45:13.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b1ce10740 10 client.5061 fetch_fsmap learned FSMap version 16 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563f805fb370 con 0x563f801f26f0 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6aee7fc640 1 -- 172.21.15.42:0/1717432224 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0003c520 con 0x563f801f26f0 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6aee7fc640 1 -- 172.21.15.42:0/1717432224 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f6b00061020 con 0x563f801f26f0 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.692+0000 7f6b1ce10740 10 client.5061 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b1ce10740 10 client.5061 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b1ce10740 20 client.5061 populate_metadata read hostname 'smithi042' 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f801da180 0x563f806044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b1ce10740 4 client.5061 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f80531050 con 0x563f801da180 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b0effd640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f801da180 0x563f806044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6b0effd640 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f801da180 0x563f806044c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c52f176218ad50e server_cookie=22a4dfffe2492530 in_seq=0 out_seq=0 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.693+0000 7f6aee7fc640 10 client.5061 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6aee7fc640 1 -- 172.21.15.42:0/1717432224 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563f80531050 con 0x563f801da180 2024-05-09T01:45:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6aee7fc640 10 client.5061 handle_command_reply: tid=0 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 client.5061 shutdown 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 msgr2=0x563f805f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f8ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009960 tx=0x7f6b00004730 comp rx=0 tx=0).stop 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 shutdown_connections 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f801da180 0x563f806044c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80603f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80612eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6aee7fc640 0 client.5061 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/1717432224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f8ab0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 >> 172.21.15.42:0/1717432224 conn(0x563f8020f700 msgr2=0x563f80603630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 shutdown_connections 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 1 -- 172.21.15.42:0/1717432224 wait complete. 2024-05-09T01:45:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.694+0000 7f6b1ce10740 20 client.5061 trim_cache size 0 max 16384 2024-05-09T01:45:13.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.712+0000 7f6b1ce10740 1 Processor -- start 2024-05-09T01:45:13.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.712+0000 7f6b1ce10740 1 -- start start 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80622ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10200670 con 0x563f801f26f0 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101f7600 con 0x563f8021b5b0 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6b101fffa0 con 0x563f801fa8d0 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45150/0 (socket says 172.21.15.42:45150) 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/3496560057 learned_addr learned my addr 172.21.15.42:0/3496560057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80622ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0effd640 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 msgr2=0x563f805fa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 msgr2=0x563f80622ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80622ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 -- 172.21.15.42:0/3496560057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f80613220 con 0x563f801f26f0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80622ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f9c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6b0002a180 tx=0x7f6b0004d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbb6a20f37ffcc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6af4ff9640 1 -- 172.21.15.42:0/3496560057 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0004d070 con 0x563f801f26f0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6af4ff9640 1 -- 172.21.15.42:0/3496560057 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0003cd10 con 0x563f801f26f0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.714+0000 7f6af4ff9640 1 -- 172.21.15.42:0/3496560057 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00037040 con 0x563f801f26f0 2024-05-09T01:45:13.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 -- 172.21.15.42:0/3496560057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 msgr2=0x563f805f9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f9c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6b0002a180 tx=0x7f6b0004d000 comp rx=0 tx=0).stop 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 -- 172.21.15.42:0/3496560057 shutdown_connections 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f8021b5b0 0x563f80622ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f805fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/3496560057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f801f26f0 0x563f805f9c90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 -- 172.21.15.42:0/3496560057 >> 172.21.15.42:0/3496560057 conn(0x563f8020f700 msgr2=0x563f805fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 -- 172.21.15.42:0/3496560057 shutdown_connections 2024-05-09T01:45:13.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.715+0000 7f6b1ce10740 1 -- 172.21.15.42:0/3496560057 wait complete. 2024-05-09T01:45:13.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.716+0000 7f6b1ce10740 1 -- start start 2024-05-09T01:45:13.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.716+0000 7f6b1ce10740 1 Processor -- start 2024-05-09T01:45:13.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80613d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f805b9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101ff8d0 con 0x563f8021b5b0 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101ff200 con 0x563f801f26f0 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1015fea0 con 0x563f801fa8d0 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b1ce10740 10 client.0 _ll_register_callbacks cb 0x7f6b0004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.717+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f805b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f805b9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45152/0 (socket says 172.21.15.42:45152) 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 -- 172.21.15.42:0/2956021725 learned_addr learned my addr 172.21.15.42:0/2956021725 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0effd640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80613d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 -- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 msgr2=0x563f80613d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80613d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 -- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 msgr2=0x563f805e0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 -- 172.21.15.42:0/2956021725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f805f8210 con 0x563f8021b5b0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b0ffff640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f805b9960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b0805db30 tx=0x7f6b08061190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79d4e2b927ba49b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6aee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6aee7fc640 1 -- 172.21.15.42:0/2956021725 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0806a310 con 0x563f8021b5b0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6aee7fc640 1 -- 172.21.15.42:0/2956021725 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6b080617a0 con 0x563f8021b5b0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b0003cd10 con 0x563f8021b5b0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6aee7fc640 1 -- 172.21.15.42:0/2956021725 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6b080619a0 con 0x563f8021b5b0 2024-05-09T01:45:13.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b1ce10740 10 client.5067 fetch_fsmap learned FSMap version 16 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563f805f84e0 con 0x563f8021b5b0 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.718+0000 7f6aee7fc640 1 -- 172.21.15.42:0/2956021725 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0003cd10 con 0x563f8021b5b0 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6aee7fc640 1 -- 172.21.15.42:0/2956021725 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f6b08069e80 con 0x563f8021b5b0 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 10 client.5067 fetch_fsmap finished waiting for FSMap version 16 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 10 client.5067 resolve_mds: validated gid 4311 aka daemon mds.d 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 20 client.5067 populate_metadata read hostname 'smithi042' 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f8067ada0 0x563f8067b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 4 client.5067 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 --> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x563f8052b080 con 0x563f8067ada0 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f8067ada0 0x563f8067b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b0f7fe640 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f8067ada0 0x563f8067b1b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680be81cab3960b5 server_cookie=ecb14ed3269a455 in_seq=0 out_seq=0 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6aee7fc640 10 client.5067 ms_handle_connect on v2:172.21.15.181:6836/1961479918 2024-05-09T01:45:13.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6aee7fc640 1 -- 172.21.15.42:0/2956021725 <== mds.0 v2:172.21.15.181:6836/1961479918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x563f8052b080 con 0x563f8067ada0 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6aee7fc640 10 client.5067 handle_command_reply: tid=0 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.719+0000 7f6b1ce10740 1 client.5067 shutdown 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 msgr2=0x563f805b9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f805b9960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b0805db30 tx=0x7f6b08061190 comp rx=0 tx=0).stop 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 shutdown_connections 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:6836/1961479918,v1:172.21.15.181:6837/1961479918] conn(0x563f8067ada0 0x563f8067b1b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f8021b5b0 0x563f805b9960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563f801fa8d0 0x563f80613d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6aee7fc640 0 client.5067 ms_handle_reset on v2:172.21.15.181:6836/1961479918 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 --2- 172.21.15.42:0/2956021725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f801f26f0 0x563f805e0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 >> 172.21.15.42:0/2956021725 conn(0x563f8020f700 msgr2=0x563f805fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 shutdown_connections 2024-05-09T01:45:13.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 1 -- 172.21.15.42:0/2956021725 wait complete. 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b1ce10740 20 client.5067 trim_cache size 0 max 16384 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 16, 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 4311, 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 12, 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": {} 2024-05-09T01:45:13.724 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:13.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6afc076300 msgr2=0x7f6afc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6afc076300 0x7f6afc078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b00034000 tx=0x7f6b0002e000 comp rx=0 tx=0).stop 2024-05-09T01:45:13.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 msgr2=0x7f6b100cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 0x7f6b100cbca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800cdb0 tx=0x7f6b0800a650 comp rx=0 tx=0).stop 2024-05-09T01:45:13.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 shutdown_connections 2024-05-09T01:45:13.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6afc076300 0x7f6afc078810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b101656f0 0x7f6b100cbca0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b100c7780 0x7f6b10160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 --2- 172.21.15.42:0/3825270631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b100b4e90 0x7f6b1015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 >> 172.21.15.42:0/3825270631 conn(0x7f6b10068e00 msgr2=0x7f6b10153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.720+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 shutdown_connections 2024-05-09T01:45:13.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.721+0000 7f6b15e84640 1 -- 172.21.15.42:0/3825270631 wait complete. 2024-05-09T01:45:13.730 INFO:tasks.quiescer:done joining Quiescers 2024-05-09T01:45:13.730 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-09T01:45:13.739 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-09T01:45:13.739 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:45:13.739 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T01:45:13.756 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:45:13.756 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T01:45:13.817 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T01:45:13.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.976+0000 7f50c9b01640 1 Processor -- start 2024-05-09T01:45:13.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.976+0000 7f50c9b01640 1 -- start start 2024-05-09T01:45:13.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c9b01640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f50c415d830 0x7f50c40ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c9b01640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c406c670 0x7f50c406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c9b01640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c4160440 con 0x7f50c4071270 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c9b01640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f50c40cf6c0 con 0x7f50c415d830 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c9b01640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f50c4073ec0 con 0x7f50c406c670 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f50c415d830 0x7f50c40ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f50c415d830 0x7f50c40ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45160/0 (socket says 172.21.15.42:45160) 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 -- 172.21.15.42:0/2552290055 learned_addr learned my addr 172.21.15.42:0/2552290055 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c2ffd640 1 --2- 172.21.15.42:0/2552290055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c406c670 0x7f50c406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 -- 172.21.15.42:0/2552290055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c406c670 msgr2=0x7f50c406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 --2- 172.21.15.42:0/2552290055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c406c670 0x7f50c406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 -- 172.21.15.42:0/2552290055 >> v1:172.21.15.181:6789/0 conn(0x7f50c4071270 legacy=0x7f50c4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.978+0000 7f50c37fe640 1 -- 172.21.15.42:0/2552290055 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c41606e0 con 0x7f50c415d830 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.979+0000 7f50c37fe640 1 --2- 172.21.15.42:0/2552290055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c415d830 0x7f50c40ca070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b378fea8cdea2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.979+0000 7f50c27fc640 1 -- 172.21.15.42:0/2552290055 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4037070 con 0x7f50c415d830 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.979+0000 7f50c27fc640 1 -- 172.21.15.42:0/2552290055 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b402ae50 con 0x7f50c415d830 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.979+0000 7f50c27fc640 1 -- 172.21.15.42:0/2552290055 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4032860 con 0x7f50c415d830 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 -- 172.21.15.42:0/2552290055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c415d830 msgr2=0x7f50c40ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2552290055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c415d830 0x7f50c40ca070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b402a300 comp rx=0 tx=0).stop 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 -- 172.21.15.42:0/2552290055 shutdown_connections 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2552290055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c406c670 0x7f50c406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2552290055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c415d830 0x7f50c40ca070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 -- 172.21.15.42:0/2552290055 >> 172.21.15.42:0/2552290055 conn(0x7f50c406de10 msgr2=0x7f50c40cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 -- 172.21.15.42:0/2552290055 shutdown_connections 2024-05-09T01:45:13.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.980+0000 7f50c9b01640 1 -- 172.21.15.42:0/2552290055 wait complete. 2024-05-09T01:45:13.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.981+0000 7f50c9b01640 1 Processor -- start 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.982+0000 7f50c9b01640 1 -- start start 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c9b01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 0x7f50c41f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c9b01640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50c4071270 0x7f50c4157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c9b01640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c415d830 0x7f50c415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c9b01640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4074180 con 0x7f50c406c670 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c9b01640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4160ca0 con 0x7f50c4071270 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c9b01640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f50c415dc40 con 0x7f50c415d830 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 0x7f50c41f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 0x7f50c41f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45174/0 (socket says 172.21.15.42:45174) 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 -- 172.21.15.42:0/2263913389 learned_addr learned my addr 172.21.15.42:0/2263913389 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c2ffd640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50c4071270 0x7f50c4157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c3fff640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c415d830 0x7f50c415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 -- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c415d830 msgr2=0x7f50c415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c415d830 0x7f50c415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 -- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50c4071270 msgr2=0x7f50c4157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50c4071270 0x7f50c4157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.983+0000 7f50c37fe640 1 -- 172.21.15.42:0/2263913389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c40c5ef0 con 0x7f50c406c670 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.984+0000 7f50c37fe640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 0x7f50c41f2fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.984+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4041070 con 0x7f50c406c670 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.984+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b403c670 con 0x7f50c406c670 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.984+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c40c4a90 con 0x7f50c406c670 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.984+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4037040 con 0x7f50c406c670 2024-05-09T01:45:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.984+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c40c5050 con 0x7f50c406c670 2024-05-09T01:45:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.985+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c4069e30 con 0x7f50c406c670 2024-05-09T01:45:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.986+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50b4044070 con 0x7f50c406c670 2024-05-09T01:45:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.986+0000 7f50abfff640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50b00762d0 0x7f50b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.986+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f50b40b8050 con 0x7f50c406c670 2024-05-09T01:45:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.986+0000 7f50c2ffd640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50b00762d0 0x7f50b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:13.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.987+0000 7f50c2ffd640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50b00762d0 0x7f50b00787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50b8006fd0 tx=0x7f50b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:13.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:13.990+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f50b4081a10 con 0x7f50c406c670 2024-05-09T01:45:14.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.193+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f50c4074400 con 0x7f50c406c670 2024-05-09T01:45:14.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.193+0000 7f50abfff640 1 -- 172.21.15.42:0/2263913389 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f50b4081310 con 0x7f50c406c670 2024-05-09T01:45:14.191 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50b00762d0 msgr2=0x7f50b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50b00762d0 0x7f50b00787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50b8006fd0 tx=0x7f50b8008040 comp rx=0 tx=0).stop 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 msgr2=0x7f50c41f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 0x7f50c41f2fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b40046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 shutdown_connections 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f50b00762d0 0x7f50b00787e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f50c415d830 0x7f50c415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50c4071270 0x7f50c4157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 --2- 172.21.15.42:0/2263913389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50c406c670 0x7f50c41f2fe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 >> 172.21.15.42:0/2263913389 conn(0x7f50c406de10 msgr2=0x7f50c40ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:14.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 shutdown_connections 2024-05-09T01:45:14.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.195+0000 7f50c9b01640 1 -- 172.21.15.42:0/2263913389 wait complete. 2024-05-09T01:45:14.205 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-09T01:45:14.205 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T01:45:14.222 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T01:45:14.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.381+0000 7f269711c640 1 Processor -- start 2024-05-09T01:45:14.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.381+0000 7f269711c640 1 -- start start 2024-05-09T01:45:14.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f269711c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f269006e990 0x7f2690156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:14.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f269711c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26900ce880 con 0x7f26900c7020 2024-05-09T01:45:14.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f269711c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269015d7f0 con 0x7f26900cd270 2024-05-09T01:45:14.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f269711c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f26900ccb00 con 0x7f269006e990 2024-05-09T01:45:14.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f268ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f269006e990 0x7f2690156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:14.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f2694eb8640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f26900c7020 0x7f269006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34986/0 (socket says 172.21.15.42:34986) 2024-05-09T01:45:14.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f2694eb8640 1 -- 172.21.15.42:0/2611544172 learned_addr learned my addr 172.21.15.42:0/2611544172 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:14.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f268ffff640 1 -- 172.21.15.42:0/2611544172 >> v1:172.21.15.181:6789/0 conn(0x7f26900cd270 legacy=0x7f26900cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:14.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f268ffff640 1 -- 172.21.15.42:0/2611544172 >> v1:172.21.15.42:6789/0 conn(0x7f26900c7020 legacy=0x7f269006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f268ffff640 1 -- 172.21.15.42:0/2611544172 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26900ce020 con 0x7f269006e990 2024-05-09T01:45:14.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.383+0000 7f268f7fe640 1 -- 172.21.15.42:0/2611544172 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582560256 0 0) 0x7f26900ce880 con 0x7f26900c7020 2024-05-09T01:45:14.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.384+0000 7f268ffff640 1 --2- 172.21.15.42:0/2611544172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f2690156d40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2678009d90 tx=0x7f267802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484fb9aa330ef9e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.384+0000 7f268f7fe640 1 -- 172.21.15.42:0/2611544172 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678031600 con 0x7f269006e990 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.384+0000 7f268f7fe640 1 -- 172.21.15.42:0/2611544172 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26780317a0 con 0x7f269006e990 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.384+0000 7f268f7fe640 1 -- 172.21.15.42:0/2611544172 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678031b70 con 0x7f269006e990 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 -- 172.21.15.42:0/2611544172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 msgr2=0x7f2690156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 --2- 172.21.15.42:0/2611544172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f2690156d40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2678009d90 tx=0x7f267802a5d0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 -- 172.21.15.42:0/2611544172 shutdown_connections 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 --2- 172.21.15.42:0/2611544172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f2690156d40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 -- 172.21.15.42:0/2611544172 >> 172.21.15.42:0/2611544172 conn(0x7f2690068ef0 msgr2=0x7f26900d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:14.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 -- 172.21.15.42:0/2611544172 shutdown_connections 2024-05-09T01:45:14.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.385+0000 7f269711c640 1 -- 172.21.15.42:0/2611544172 wait complete. 2024-05-09T01:45:14.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.387+0000 7f269711c640 1 Processor -- start 2024-05-09T01:45:14.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.387+0000 7f269711c640 1 -- start start 2024-05-09T01:45:14.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f269711c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f269015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:14.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f269711c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26900c7020 0x7f269015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:14.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f269711c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26900cd270 0x7f269014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f269711c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f269015da90 con 0x7f269006e990 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f269711c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f26900ccde0 con 0x7f26900cd270 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f269711c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f269006dcc0 con 0x7f26900c7020 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f2694eb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f269015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f2694eb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f269015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45194/0 (socket says 172.21.15.42:45194) 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.388+0000 7f2694eb8640 1 -- 172.21.15.42:0/358458473 learned_addr learned my addr 172.21.15.42:0/358458473 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:14.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f26956b9640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26900cd270 0x7f269014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f268ffff640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26900c7020 0x7f269015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f2694eb8640 1 -- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26900c7020 msgr2=0x7f269015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f2694eb8640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26900c7020 0x7f269015bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f2694eb8640 1 -- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26900cd270 msgr2=0x7f269014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f2694eb8640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26900cd270 0x7f269014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f2694eb8640 1 -- 172.21.15.42:0/358458473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26901f6f50 con 0x7f269006e990 2024-05-09T01:45:14.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f26956b9640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26900cd270 0x7f269014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f2694eb8640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f269015a1e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f268000c3e0 tx=0x7f268000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800074e0 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26800047e0 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680004bd0 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26901f2f30 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.389+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26901f34d0 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.390+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26900b7bd0 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.391+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2680011070 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.391+0000 7f268d7fa640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f26700762d0 0x7f26700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.391+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2680097350 con 0x7f269006e990 2024-05-09T01:45:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.392+0000 7f268ffff640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f26700762d0 0x7f26700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:14.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.392+0000 7f268ffff640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f26700762d0 0x7f26700787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2678034000 tx=0x7f267802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:14.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.396+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2680060bb0 con 0x7f269006e990 2024-05-09T01:45:14.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.602+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26900ce250 con 0x7f269006e990 2024-05-09T01:45:14.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.602+0000 7f268d7fa640 1 -- 172.21.15.42:0/358458473 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f26800604b0 con 0x7f269006e990 2024-05-09T01:45:14.600 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-05-09T01:45:14.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f26700762d0 msgr2=0x7f26700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f26700762d0 0x7f26700787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2678034000 tx=0x7f267802f000 comp rx=0 tx=0).stop 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 msgr2=0x7f269015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f269015a1e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f268000c3e0 tx=0x7f268000c8a0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 shutdown_connections 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f26700762d0 0x7f26700787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26900cd270 0x7f269014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26900c7020 0x7f269015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 --2- 172.21.15.42:0/358458473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f269006e990 0x7f269015a1e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 >> 172.21.15.42:0/358458473 conn(0x7f2690068ef0 msgr2=0x7f26900b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 shutdown_connections 2024-05-09T01:45:14.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:14.605+0000 7f269711c640 1 -- 172.21.15.42:0/358458473 wait complete. 2024-05-09T01:45:14.614 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi042.front.sepia.ceph.com... 2024-05-09T01:45:14.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:45:14.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-09T01:45:14.642 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:14.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:ceph-fuse[43375]: fuse finished with error 0 and tester_r 0 2024-05-09T01:45:14.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:45:14.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:45:14.740 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T01:45:14.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:45:14.768 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-05-09T01:45:14.824 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T01:45:14.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:45:14.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T01:45:14.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:45:14.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-05-09T01:45:14.990 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T01:45:15.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T01:45:15.004 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:45:15.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.162+0000 7f5c4622b640 1 Processor -- start 2024-05-09T01:45:15.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.163+0000 7f5c4622b640 1 -- start start 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c4622b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c40074910 0x7f5c400c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c4622b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 0x7f5c400700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c4622b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c400c5330 con 0x7f5c40153840 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c4622b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5c400c7f50 con 0x7f5c40074910 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c4622b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5c40072cf0 con 0x7f5c40153430 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c3effd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 0x7f5c400700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c3effd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 0x7f5c400700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:40700/0 (socket says 172.21.15.42:40700) 2024-05-09T01:45:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.164+0000 7f5c3effd640 1 -- 172.21.15.42:0/285180001 learned_addr learned my addr 172.21.15.42:0/285180001 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.165+0000 7f5c3effd640 1 -- 172.21.15.42:0/285180001 >> v2:172.21.15.181:3300/0 conn(0x7f5c40074910 msgr2=0x7f5c400c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.165+0000 7f5c3effd640 1 --2- 172.21.15.42:0/285180001 >> v2:172.21.15.181:3300/0 conn(0x7f5c40074910 0x7f5c400c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.165+0000 7f5c3effd640 1 -- 172.21.15.42:0/285180001 >> v1:172.21.15.181:6789/0 conn(0x7f5c40153840 legacy=0x7f5c400c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.165+0000 7f5c3effd640 1 -- 172.21.15.42:0/285180001 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c40074d20 con 0x7f5c40153430 2024-05-09T01:45:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.166+0000 7f5c3effd640 1 --2- 172.21.15.42:0/285180001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 0x7f5c400700c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009870 tx=0x7f5c3402b2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9fe3be51c2730f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.166+0000 7f5c3e7fc640 1 -- 172.21.15.42:0/285180001 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34038070 con 0x7f5c40153430 2024-05-09T01:45:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.166+0000 7f5c3e7fc640 1 -- 172.21.15.42:0/285180001 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c34033640 con 0x7f5c40153430 2024-05-09T01:45:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.166+0000 7f5c3e7fc640 1 -- 172.21.15.42:0/285180001 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34033a10 con 0x7f5c40153430 2024-05-09T01:45:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.167+0000 7f5c4622b640 1 -- 172.21.15.42:0/285180001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 msgr2=0x7f5c400700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.167+0000 7f5c4622b640 1 --2- 172.21.15.42:0/285180001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 0x7f5c400700c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009870 tx=0x7f5c3402b2d0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.167+0000 7f5c4622b640 1 -- 172.21.15.42:0/285180001 shutdown_connections 2024-05-09T01:45:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.167+0000 7f5c4622b640 1 --2- 172.21.15.42:0/285180001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153430 0x7f5c400700c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.167+0000 7f5c4622b640 1 --2- 172.21.15.42:0/285180001 >> v2:172.21.15.181:3300/0 conn(0x7f5c40074910 0x7f5c400c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.167+0000 7f5c4622b640 1 -- 172.21.15.42:0/285180001 >> 172.21.15.42:0/285180001 conn(0x7f5c4006cdc0 msgr2=0x7f5c400cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:15.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.168+0000 7f5c4622b640 1 -- 172.21.15.42:0/285180001 shutdown_connections 2024-05-09T01:45:15.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.168+0000 7f5c4622b640 1 -- 172.21.15.42:0/285180001 wait complete. 2024-05-09T01:45:15.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.170+0000 7f5c4622b640 1 Processor -- start 2024-05-09T01:45:15.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.171+0000 7f5c4622b640 1 -- start start 2024-05-09T01:45:15.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.173+0000 7f5c4622b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 0x7f5c40147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.173+0000 7f5c4622b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 0x7f5c401e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.174+0000 7f5c3effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 0x7f5c401e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.174+0000 7f5c3f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 0x7f5c40147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.174+0000 7f5c3effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 0x7f5c401e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50996/0 (socket says 172.21.15.42:50996) 2024-05-09T01:45:15.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.174+0000 7f5c3f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 0x7f5c40147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45200/0 (socket says 172.21.15.42:45200) 2024-05-09T01:45:15.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.174+0000 7f5c4622b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153840 0x7f5c401e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.174+0000 7f5c3effd640 1 -- 172.21.15.42:0/60074266 learned_addr learned my addr 172.21.15.42:0/60074266 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:15.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3ffff640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153840 0x7f5c401e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400c58d0 con 0x7f5c40074910 2024-05-09T01:45:15.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400c8730 con 0x7f5c40153430 2024-05-09T01:45:15.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5c400c9fd0 con 0x7f5c40153840 2024-05-09T01:45:15.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3effd640 1 -- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153840 msgr2=0x7f5c401e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3effd640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153840 0x7f5c401e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3effd640 1 -- 172.21.15.42:0/60074266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 msgr2=0x7f5c40147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3effd640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 0x7f5c40147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3effd640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c40147b60 con 0x7f5c40153430 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.175+0000 7f5c3f7fe640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 0x7f5c40147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.176+0000 7f5c3effd640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 0x7f5c401e4800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009870 tx=0x7f5c340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.176+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34042020 con 0x7f5c40153430 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.176+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c34031910 con 0x7f5c40153430 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.176+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4014e330 con 0x7f5c40153430 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.176+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c401e1f40 con 0x7f5c40153430 2024-05-09T01:45:15.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.176+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34038040 con 0x7f5c40153430 2024-05-09T01:45:15.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.179+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c401e6bb0 con 0x7f5c40153430 2024-05-09T01:45:15.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.179+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c34045020 con 0x7f5c40153430 2024-05-09T01:45:15.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.180+0000 7f5c27fff640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5c2c0763a0 0x7f5c2c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.180+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5c340b7ef0 con 0x7f5c40153430 2024-05-09T01:45:15.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.181+0000 7f5c3f7fe640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5c2c0763a0 0x7f5c2c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.181+0000 7f5c3f7fe640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5c2c0763a0 0x7f5c2c0788b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009cb0 tx=0x7f5c30009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.189+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c3404c030 con 0x7f5c40153430 2024-05-09T01:45:15.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.469+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c401e87b0 con 0x7f5c2c0763a0 2024-05-09T01:45:15.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.476+0000 7f5c27fff640 1 -- 172.21.15.42:0/60074266 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253845 (secure 0 0 0) 0x7f5c401e87b0 con 0x7f5c2c0763a0 2024-05-09T01:45:15.477 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:15.478 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5c2c0763a0 msgr2=0x7f5c2c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5c2c0763a0 0x7f5c2c0788b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009cb0 tx=0x7f5c30009060 comp rx=0 tx=0).stop 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 msgr2=0x7f5c401e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 0x7f5c401e4800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009870 tx=0x7f5c340046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 shutdown_connections 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5c2c0763a0 0x7f5c2c0788b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c40153840 0x7f5c401e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c40153430 0x7f5c401e4800 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 --2- 172.21.15.42:0/60074266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c40074910 0x7f5c40147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 >> 172.21.15.42:0/60074266 conn(0x7f5c4006cdc0 msgr2=0x7f5c4014d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:15.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 shutdown_connections 2024-05-09T01:45:15.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.480+0000 7f5c4622b640 1 -- 172.21.15.42:0/60074266 wait complete. 2024-05-09T01:45:15.491 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-05-09T01:45:14.279646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10738200753,"num_objects":2661,"num_object_clones":0,"num_object_copies":5322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2661,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":7080,"num_write_kb":25167738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7017,"ondisk_log_size":7017,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21270288,"kb_used_data":20975120,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":733704432,"statfs":{"total":773094113280,"available":751313338368,"internally_reserved":0,"allocated":21478522880,"data_stored":21477086602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003487"},"pg_stats":[{"pgid":"3.3f","version":"23'100","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.140726+0000","last_change":"2024-05-09T01:41:41.348265+0000","last_active":"2024-05-09T01:44:57.140726+0000","last_peered":"2024-05-09T01:44:57.140726+0000","last_clean":"2024-05-09T01:44:57.140726+0000","last_became_active":"2024-05-09T01:41:41.347858+0000","last_became_peered":"2024-05-09T01:41:41.347858+0000","last_unstale":"2024-05-09T01:44:57.140726+0000","last_undegraded":"2024-05-09T01:44:57.140726+0000","last_fullsized":"2024-05-09T01:44:57.140726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.121897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"23'90","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.659423+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:44:57.659423+0000","last_peered":"2024-05-09T01:44:57.659423+0000","last_clean":"2024-05-09T01:44:57.659423+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:44:57.659423+0000","last_undegraded":"2024-05-09T01:44:57.659423+0000","last_fullsized":"2024-05-09T01:44:57.659423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'103","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.012787+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:44:57.012787+0000","last_peered":"2024-05-09T01:44:57.012787+0000","last_clean":"2024-05-09T01:44:57.012787+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:44:57.012787+0000","last_undegraded":"2024-05-09T01:44:57.012787+0000","last_fullsized":"2024-05-09T01:44:57.012787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'115","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.741472+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:44:57.741472+0000","last_peered":"2024-05-09T01:44:57.741472+0000","last_clean":"2024-05-09T01:44:57.741472+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:44:57.741472+0000","last_undegraded":"2024-05-09T01:44:57.741472+0000","last_fullsized":"2024-05-09T01:44:57.741472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'105","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.542755+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:44:57.542755+0000","last_peered":"2024-05-09T01:44:57.542755+0000","last_clean":"2024-05-09T01:44:57.542755+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:44:57.542755+0000","last_undegraded":"2024-05-09T01:44:57.542755+0000","last_fullsized":"2024-05-09T01:44:57.542755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'93","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.425184+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:44:57.425184+0000","last_peered":"2024-05-09T01:44:57.425184+0000","last_clean":"2024-05-09T01:44:57.425184+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:44:57.425184+0000","last_undegraded":"2024-05-09T01:44:57.425184+0000","last_fullsized":"2024-05-09T01:44:57.425184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'114","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.156044+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:44:57.156044+0000","last_peered":"2024-05-09T01:44:57.156044+0000","last_clean":"2024-05-09T01:44:57.156044+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:44:57.156044+0000","last_undegraded":"2024-05-09T01:44:57.156044+0000","last_fullsized":"2024-05-09T01:44:57.156044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'126","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.595872+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:44:57.595872+0000","last_peered":"2024-05-09T01:44:57.595872+0000","last_clean":"2024-05-09T01:44:57.595872+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:44:57.595872+0000","last_undegraded":"2024-05-09T01:44:57.595872+0000","last_fullsized":"2024-05-09T01:44:57.595872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.249110+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:44:57.249110+0000","last_peered":"2024-05-09T01:44:57.249110+0000","last_clean":"2024-05-09T01:44:57.249110+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:44:57.249110+0000","last_undegraded":"2024-05-09T01:44:57.249110+0000","last_fullsized":"2024-05-09T01:44:57.249110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.336714+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:44:57.336714+0000","last_peered":"2024-05-09T01:44:57.336714+0000","last_clean":"2024-05-09T01:44:57.336714+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:44:57.336714+0000","last_undegraded":"2024-05-09T01:44:57.336714+0000","last_fullsized":"2024-05-09T01:44:57.336714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'129","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.125217+0000","last_change":"2024-05-09T01:41:41.345044+0000","last_active":"2024-05-09T01:44:57.125217+0000","last_peered":"2024-05-09T01:44:57.125217+0000","last_clean":"2024-05-09T01:44:57.125217+0000","last_became_active":"2024-05-09T01:41:41.344652+0000","last_became_peered":"2024-05-09T01:41:41.344652+0000","last_unstale":"2024-05-09T01:44:57.125217+0000","last_undegraded":"2024-05-09T01:44:57.125217+0000","last_fullsized":"2024-05-09T01:44:57.125217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:09.272509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.260492+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:44:57.260492+0000","last_peered":"2024-05-09T01:44:57.260492+0000","last_clean":"2024-05-09T01:44:57.260492+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:44:57.260492+0000","last_undegraded":"2024-05-09T01:44:57.260492+0000","last_fullsized":"2024-05-09T01:44:57.260492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.064173+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:44:57.064173+0000","last_peered":"2024-05-09T01:44:57.064173+0000","last_clean":"2024-05-09T01:44:57.064173+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:44:57.064173+0000","last_undegraded":"2024-05-09T01:44:57.064173+0000","last_fullsized":"2024-05-09T01:44:57.064173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.253820+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:44:57.253820+0000","last_peered":"2024-05-09T01:44:57.253820+0000","last_clean":"2024-05-09T01:44:57.253820+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:44:57.253820+0000","last_undegraded":"2024-05-09T01:44:57.253820+0000","last_fullsized":"2024-05-09T01:44:57.253820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.397067+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:44:57.397067+0000","last_peered":"2024-05-09T01:44:57.397067+0000","last_clean":"2024-05-09T01:44:57.397067+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:44:57.397067+0000","last_undegraded":"2024-05-09T01:44:57.397067+0000","last_fullsized":"2024-05-09T01:44:57.397067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'102","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.871512+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:44:56.871512+0000","last_peered":"2024-05-09T01:44:56.871512+0000","last_clean":"2024-05-09T01:44:56.871512+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:44:56.871512+0000","last_undegraded":"2024-05-09T01:44:56.871512+0000","last_fullsized":"2024-05-09T01:44:56.871512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'96","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.053124+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:44:57.053124+0000","last_peered":"2024-05-09T01:44:57.053124+0000","last_clean":"2024-05-09T01:44:57.053124+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:44:57.053124+0000","last_undegraded":"2024-05-09T01:44:57.053124+0000","last_fullsized":"2024-05-09T01:44:57.053124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.723281+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:44:57.723281+0000","last_peered":"2024-05-09T01:44:57.723281+0000","last_clean":"2024-05-09T01:44:57.723281+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:44:57.723281+0000","last_undegraded":"2024-05-09T01:44:57.723281+0000","last_fullsized":"2024-05-09T01:44:57.723281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'116","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.552790+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:44:57.552790+0000","last_peered":"2024-05-09T01:44:57.552790+0000","last_clean":"2024-05-09T01:44:57.552790+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:44:57.552790+0000","last_undegraded":"2024-05-09T01:44:57.552790+0000","last_fullsized":"2024-05-09T01:44:57.552790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.391808+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:44:57.391808+0000","last_peered":"2024-05-09T01:44:57.391808+0000","last_clean":"2024-05-09T01:44:57.391808+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:44:57.391808+0000","last_undegraded":"2024-05-09T01:44:57.391808+0000","last_fullsized":"2024-05-09T01:44:57.391808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'91","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.655028+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:44:57.655028+0000","last_peered":"2024-05-09T01:44:57.655028+0000","last_clean":"2024-05-09T01:44:57.655028+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:44:57.655028+0000","last_undegraded":"2024-05-09T01:44:57.655028+0000","last_fullsized":"2024-05-09T01:44:57.655028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'113","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.544704+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:44:57.544704+0000","last_peered":"2024-05-09T01:44:57.544704+0000","last_clean":"2024-05-09T01:44:57.544704+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:44:57.544704+0000","last_undegraded":"2024-05-09T01:44:57.544704+0000","last_fullsized":"2024-05-09T01:44:57.544704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'90","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:55.698932+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:44:55.698932+0000","last_peered":"2024-05-09T01:44:55.698932+0000","last_clean":"2024-05-09T01:44:55.698932+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:44:55.698932+0000","last_undegraded":"2024-05-09T01:44:55.698932+0000","last_fullsized":"2024-05-09T01:44:55.698932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'125","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.575932+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:44:56.575932+0000","last_peered":"2024-05-09T01:44:56.575932+0000","last_clean":"2024-05-09T01:44:56.575932+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:44:56.575932+0000","last_undegraded":"2024-05-09T01:44:56.575932+0000","last_fullsized":"2024-05-09T01:44:56.575932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'94","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.357660+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:44:57.357660+0000","last_peered":"2024-05-09T01:44:57.357660+0000","last_clean":"2024-05-09T01:44:57.357660+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:44:57.357660+0000","last_undegraded":"2024-05-09T01:44:57.357660+0000","last_fullsized":"2024-05-09T01:44:57.357660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'135","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.525486+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:44:57.525486+0000","last_peered":"2024-05-09T01:44:57.525486+0000","last_clean":"2024-05-09T01:44:57.525486+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:44:57.525486+0000","last_undegraded":"2024-05-09T01:44:57.525486+0000","last_fullsized":"2024-05-09T01:44:57.525486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'98","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.325305+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:44:57.325305+0000","last_peered":"2024-05-09T01:44:57.325305+0000","last_clean":"2024-05-09T01:44:57.325305+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:44:57.325305+0000","last_undegraded":"2024-05-09T01:44:57.325305+0000","last_fullsized":"2024-05-09T01:44:57.325305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'94","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.399507+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:44:57.399507+0000","last_peered":"2024-05-09T01:44:57.399507+0000","last_clean":"2024-05-09T01:44:57.399507+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:44:57.399507+0000","last_undegraded":"2024-05-09T01:44:57.399507+0000","last_fullsized":"2024-05-09T01:44:57.399507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'83","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.510734+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:44:57.510734+0000","last_peered":"2024-05-09T01:44:57.510734+0000","last_clean":"2024-05-09T01:44:57.510734+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:44:57.510734+0000","last_undegraded":"2024-05-09T01:44:57.510734+0000","last_fullsized":"2024-05-09T01:44:57.510734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.396506+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:44:57.396506+0000","last_peered":"2024-05-09T01:44:57.396506+0000","last_clean":"2024-05-09T01:44:57.396506+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:44:57.396506+0000","last_undegraded":"2024-05-09T01:44:57.396506+0000","last_fullsized":"2024-05-09T01:44:57.396506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'90","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.681609+0000","last_change":"2024-05-09T01:41:41.644145+0000","last_active":"2024-05-09T01:44:57.681609+0000","last_peered":"2024-05-09T01:44:57.681609+0000","last_clean":"2024-05-09T01:44:57.681609+0000","last_became_active":"2024-05-09T01:41:41.643556+0000","last_became_peered":"2024-05-09T01:41:41.643556+0000","last_unstale":"2024-05-09T01:44:57.681609+0000","last_undegraded":"2024-05-09T01:44:57.681609+0000","last_fullsized":"2024-05-09T01:44:57.681609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:20.778053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'106","reported_seq":124,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.743126+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:44:57.743126+0000","last_peered":"2024-05-09T01:44:57.743126+0000","last_clean":"2024-05-09T01:44:57.743126+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:44:57.743126+0000","last_undegraded":"2024-05-09T01:44:57.743126+0000","last_fullsized":"2024-05-09T01:44:57.743126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'88","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.443284+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:44:56.443284+0000","last_peered":"2024-05-09T01:44:56.443284+0000","last_clean":"2024-05-09T01:44:56.443284+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:44:56.443284+0000","last_undegraded":"2024-05-09T01:44:56.443284+0000","last_fullsized":"2024-05-09T01:44:56.443284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.642593+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:41.642593+0000","last_peered":"2024-05-09T01:41:41.642593+0000","last_clean":"2024-05-09T01:41:41.642593+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:41.642593+0000","last_undegraded":"2024-05-09T01:41:41.642593+0000","last_fullsized":"2024-05-09T01:41:41.642593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'94","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.860452+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:44:56.860452+0000","last_peered":"2024-05-09T01:44:56.860452+0000","last_clean":"2024-05-09T01:44:56.860452+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:44:56.860452+0000","last_undegraded":"2024-05-09T01:44:56.860452+0000","last_fullsized":"2024-05-09T01:44:56.860452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.342371+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:41.342371+0000","last_peered":"2024-05-09T01:41:41.342371+0000","last_clean":"2024-05-09T01:41:41.342371+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:41.342371+0000","last_undegraded":"2024-05-09T01:41:41.342371+0000","last_fullsized":"2024-05-09T01:41:41.342371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.642318+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:41.642318+0000","last_peered":"2024-05-09T01:41:41.642318+0000","last_clean":"2024-05-09T01:41:41.642318+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:41.642318+0000","last_undegraded":"2024-05-09T01:41:41.642318+0000","last_fullsized":"2024-05-09T01:41:41.642318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'115","reported_seq":132,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.078328+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:44:57.078328+0000","last_peered":"2024-05-09T01:44:57.078328+0000","last_clean":"2024-05-09T01:44:57.078328+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:44:57.078328+0000","last_undegraded":"2024-05-09T01:44:57.078328+0000","last_fullsized":"2024-05-09T01:44:57.078328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343074+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:41.343074+0000","last_peered":"2024-05-09T01:41:41.343074+0000","last_clean":"2024-05-09T01:41:41.343074+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:41.343074+0000","last_undegraded":"2024-05-09T01:41:41.343074+0000","last_fullsized":"2024-05-09T01:41:41.343074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'104","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.317257+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:44:56.317257+0000","last_peered":"2024-05-09T01:44:56.317257+0000","last_clean":"2024-05-09T01:44:56.317257+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:44:56.317257+0000","last_undegraded":"2024-05-09T01:44:56.317257+0000","last_fullsized":"2024-05-09T01:44:56.317257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:27.240057+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:43:27.240057+0000","last_peered":"2024-05-09T01:43:27.240057+0000","last_clean":"2024-05-09T01:43:27.240057+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:43:27.240057+0000","last_undegraded":"2024-05-09T01:43:27.240057+0000","last_fullsized":"2024-05-09T01:43:27.240057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'157","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.788115+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:44:57.788115+0000","last_peered":"2024-05-09T01:44:57.788115+0000","last_clean":"2024-05-09T01:44:57.788115+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:44:57.788115+0000","last_undegraded":"2024-05-09T01:44:57.788115+0000","last_fullsized":"2024-05-09T01:44:57.788115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343467+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:41.343467+0000","last_peered":"2024-05-09T01:41:41.343467+0000","last_clean":"2024-05-09T01:41:41.343467+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:41.343467+0000","last_undegraded":"2024-05-09T01:41:41.343467+0000","last_fullsized":"2024-05-09T01:41:41.343467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'97","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.555326+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:44:57.555326+0000","last_peered":"2024-05-09T01:44:57.555326+0000","last_clean":"2024-05-09T01:44:57.555326+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:44:57.555326+0000","last_undegraded":"2024-05-09T01:44:57.555326+0000","last_fullsized":"2024-05-09T01:44:57.555326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:52.908396+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:43:52.908396+0000","last_peered":"2024-05-09T01:43:52.908396+0000","last_clean":"2024-05-09T01:43:52.908396+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:43:52.908396+0000","last_undegraded":"2024-05-09T01:43:52.908396+0000","last_fullsized":"2024-05-09T01:43:52.908396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.140178+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:44:57.140178+0000","last_peered":"2024-05-09T01:44:57.140178+0000","last_clean":"2024-05-09T01:44:57.140178+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:44:57.140178+0000","last_undegraded":"2024-05-09T01:44:57.140178+0000","last_fullsized":"2024-05-09T01:44:57.140178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'89","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.786258+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:44:57.786258+0000","last_peered":"2024-05-09T01:44:57.786258+0000","last_clean":"2024-05-09T01:44:57.786258+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:44:57.786258+0000","last_undegraded":"2024-05-09T01:44:57.786258+0000","last_fullsized":"2024-05-09T01:44:57.786258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184198,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'106","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.709212+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:44:56.709212+0000","last_peered":"2024-05-09T01:44:56.709212+0000","last_clean":"2024-05-09T01:44:56.709212+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:44:56.709212+0000","last_undegraded":"2024-05-09T01:44:56.709212+0000","last_fullsized":"2024-05-09T01:44:56.709212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.643078+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:41.643078+0000","last_peered":"2024-05-09T01:41:41.643078+0000","last_clean":"2024-05-09T01:41:41.643078+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:41.643078+0000","last_undegraded":"2024-05-09T01:41:41.643078+0000","last_fullsized":"2024-05-09T01:41:41.643078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.335096+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:44:57.335096+0000","last_peered":"2024-05-09T01:44:57.335096+0000","last_clean":"2024-05-09T01:44:57.335096+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:44:57.335096+0000","last_undegraded":"2024-05-09T01:44:57.335096+0000","last_fullsized":"2024-05-09T01:44:57.335096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343136+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:41.343136+0000","last_peered":"2024-05-09T01:41:41.343136+0000","last_clean":"2024-05-09T01:41:41.343136+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:41.343136+0000","last_undegraded":"2024-05-09T01:41:41.343136+0000","last_fullsized":"2024-05-09T01:41:41.343136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'109","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.163468+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:44:57.163468+0000","last_peered":"2024-05-09T01:44:57.163468+0000","last_clean":"2024-05-09T01:44:57.163468+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:44:57.163468+0000","last_undegraded":"2024-05-09T01:44:57.163468+0000","last_fullsized":"2024-05-09T01:44:57.163468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.342146+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:41.342146+0000","last_peered":"2024-05-09T01:41:41.342146+0000","last_clean":"2024-05-09T01:41:41.342146+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:41.342146+0000","last_undegraded":"2024-05-09T01:41:41.342146+0000","last_fullsized":"2024-05-09T01:41:41.342146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'119","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.362040+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:44:57.362040+0000","last_peered":"2024-05-09T01:44:57.362040+0000","last_clean":"2024-05-09T01:44:57.362040+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:44:57.362040+0000","last_undegraded":"2024-05-09T01:44:57.362040+0000","last_fullsized":"2024-05-09T01:44:57.362040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.339844+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:41.339844+0000","last_peered":"2024-05-09T01:41:41.339844+0000","last_clean":"2024-05-09T01:41:41.339844+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:41.339844+0000","last_undegraded":"2024-05-09T01:41:41.339844+0000","last_fullsized":"2024-05-09T01:41:41.339844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'137","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.209109+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:44:57.209109+0000","last_peered":"2024-05-09T01:44:57.209109+0000","last_clean":"2024-05-09T01:44:57.209109+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:44:57.209109+0000","last_undegraded":"2024-05-09T01:44:57.209109+0000","last_fullsized":"2024-05-09T01:44:57.209109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.344769+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:41.344769+0000","last_peered":"2024-05-09T01:41:41.344769+0000","last_clean":"2024-05-09T01:41:41.344769+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:41.344769+0000","last_undegraded":"2024-05-09T01:41:41.344769+0000","last_fullsized":"2024-05-09T01:41:41.344769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'100","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.249205+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:44:57.249205+0000","last_peered":"2024-05-09T01:44:57.249205+0000","last_clean":"2024-05-09T01:44:57.249205+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:44:57.249205+0000","last_undegraded":"2024-05-09T01:44:57.249205+0000","last_fullsized":"2024-05-09T01:44:57.249205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.340309+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:41.340309+0000","last_peered":"2024-05-09T01:41:41.340309+0000","last_clean":"2024-05-09T01:41:41.340309+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:41.340309+0000","last_undegraded":"2024-05-09T01:41:41.340309+0000","last_fullsized":"2024-05-09T01:41:41.340309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'92","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.027702+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:44:57.027702+0000","last_peered":"2024-05-09T01:44:57.027702+0000","last_clean":"2024-05-09T01:44:57.027702+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:44:57.027702+0000","last_undegraded":"2024-05-09T01:44:57.027702+0000","last_fullsized":"2024-05-09T01:44:57.027702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.644397+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:41.644397+0000","last_peered":"2024-05-09T01:41:41.644397+0000","last_clean":"2024-05-09T01:41:41.644397+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:41.644397+0000","last_undegraded":"2024-05-09T01:41:41.644397+0000","last_fullsized":"2024-05-09T01:41:41.644397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.869270+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:44:56.869270+0000","last_peered":"2024-05-09T01:44:56.869270+0000","last_clean":"2024-05-09T01:44:56.869270+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:44:56.869270+0000","last_undegraded":"2024-05-09T01:44:56.869270+0000","last_fullsized":"2024-05-09T01:44:56.869270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.340117+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:41.340117+0000","last_peered":"2024-05-09T01:41:41.340117+0000","last_clean":"2024-05-09T01:41:41.340117+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:41.340117+0000","last_undegraded":"2024-05-09T01:41:41.340117+0000","last_fullsized":"2024-05-09T01:41:41.340117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.695742+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:44:56.695742+0000","last_peered":"2024-05-09T01:44:56.695742+0000","last_clean":"2024-05-09T01:44:56.695742+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:44:56.695742+0000","last_undegraded":"2024-05-09T01:44:56.695742+0000","last_fullsized":"2024-05-09T01:44:56.695742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:42:47.243604+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:42:47.243604+0000","last_peered":"2024-05-09T01:42:47.243604+0000","last_clean":"2024-05-09T01:42:47.243604+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:42:47.243604+0000","last_undegraded":"2024-05-09T01:42:47.243604+0000","last_fullsized":"2024-05-09T01:42:47.243604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.237683+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:43:07.237683+0000","last_peered":"2024-05-09T01:43:07.237683+0000","last_clean":"2024-05-09T01:43:07.237683+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:43:07.237683+0000","last_undegraded":"2024-05-09T01:43:07.237683+0000","last_fullsized":"2024-05-09T01:43:07.237683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'106","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.552799+0000","last_change":"2024-05-09T01:41:41.345428+0000","last_active":"2024-05-09T01:44:57.552799+0000","last_peered":"2024-05-09T01:44:57.552799+0000","last_clean":"2024-05-09T01:44:57.552799+0000","last_became_active":"2024-05-09T01:41:41.345116+0000","last_became_peered":"2024-05-09T01:41:41.345116+0000","last_unstale":"2024-05-09T01:44:57.552799+0000","last_undegraded":"2024-05-09T01:44:57.552799+0000","last_fullsized":"2024-05-09T01:44:57.552799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:21.854442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:02.245378+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:43:02.245378+0000","last_peered":"2024-05-09T01:43:02.245378+0000","last_clean":"2024-05-09T01:43:02.245378+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:43:02.245378+0000","last_undegraded":"2024-05-09T01:43:02.245378+0000","last_fullsized":"2024-05-09T01:43:02.245378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'95","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.786634+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:44:57.786634+0000","last_peered":"2024-05-09T01:44:57.786634+0000","last_clean":"2024-05-09T01:44:57.786634+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:44:57.786634+0000","last_undegraded":"2024-05-09T01:44:57.786634+0000","last_fullsized":"2024-05-09T01:44:57.786634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'9","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:06.867384+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:44:06.867384+0000","last_peered":"2024-05-09T01:44:06.867384+0000","last_clean":"2024-05-09T01:44:06.867384+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:44:06.867384+0000","last_undegraded":"2024-05-09T01:44:06.867384+0000","last_fullsized":"2024-05-09T01:44:06.867384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.508611+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:44:57.508611+0000","last_peered":"2024-05-09T01:44:57.508611+0000","last_clean":"2024-05-09T01:44:57.508611+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:44:57.508611+0000","last_undegraded":"2024-05-09T01:44:57.508611+0000","last_fullsized":"2024-05-09T01:44:57.508611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.237668+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:43:07.237668+0000","last_peered":"2024-05-09T01:43:07.237668+0000","last_clean":"2024-05-09T01:43:07.237668+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:43:07.237668+0000","last_undegraded":"2024-05-09T01:43:07.237668+0000","last_fullsized":"2024-05-09T01:43:07.237668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'99","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.745935+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:44:57.745935+0000","last_peered":"2024-05-09T01:44:57.745935+0000","last_clean":"2024-05-09T01:44:57.745935+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:44:57.745935+0000","last_undegraded":"2024-05-09T01:44:57.745935+0000","last_fullsized":"2024-05-09T01:44:57.745935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:06.237964+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:43:06.237964+0000","last_peered":"2024-05-09T01:43:06.237964+0000","last_clean":"2024-05-09T01:43:06.237964+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:43:06.237964+0000","last_undegraded":"2024-05-09T01:43:06.237964+0000","last_fullsized":"2024-05-09T01:43:06.237964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'101","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.595412+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:44:57.595412+0000","last_peered":"2024-05-09T01:44:57.595412+0000","last_clean":"2024-05-09T01:44:57.595412+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:44:57.595412+0000","last_undegraded":"2024-05-09T01:44:57.595412+0000","last_fullsized":"2024-05-09T01:44:57.595412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.246226+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:43:07.246226+0000","last_peered":"2024-05-09T01:43:07.246226+0000","last_clean":"2024-05-09T01:43:07.246226+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:43:07.246226+0000","last_undegraded":"2024-05-09T01:43:07.246226+0000","last_fullsized":"2024-05-09T01:43:07.246226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'96","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.574741+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:44:57.574741+0000","last_peered":"2024-05-09T01:44:57.574741+0000","last_clean":"2024-05-09T01:44:57.574741+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:44:57.574741+0000","last_undegraded":"2024-05-09T01:44:57.574741+0000","last_fullsized":"2024-05-09T01:44:57.574741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'21","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:07.808155+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:44:07.808155+0000","last_peered":"2024-05-09T01:44:07.808155+0000","last_clean":"2024-05-09T01:44:07.808155+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:44:07.808155+0000","last_undegraded":"2024-05-09T01:44:07.808155+0000","last_fullsized":"2024-05-09T01:44:07.808155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'105","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.543297+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:44:57.543297+0000","last_peered":"2024-05-09T01:44:57.543297+0000","last_clean":"2024-05-09T01:44:57.543297+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:44:57.543297+0000","last_undegraded":"2024-05-09T01:44:57.543297+0000","last_fullsized":"2024-05-09T01:44:57.543297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343439+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:41.343439+0000","last_peered":"2024-05-09T01:41:41.343439+0000","last_clean":"2024-05-09T01:41:41.343439+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:41.343439+0000","last_undegraded":"2024-05-09T01:41:41.343439+0000","last_fullsized":"2024-05-09T01:41:41.343439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'111","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.907892+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:44:56.907892+0000","last_peered":"2024-05-09T01:44:56.907892+0000","last_clean":"2024-05-09T01:44:56.907892+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:44:56.907892+0000","last_undegraded":"2024-05-09T01:44:56.907892+0000","last_fullsized":"2024-05-09T01:44:56.907892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.641259+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:41.641259+0000","last_peered":"2024-05-09T01:41:41.641259+0000","last_clean":"2024-05-09T01:41:41.641259+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:41.641259+0000","last_undegraded":"2024-05-09T01:41:41.641259+0000","last_fullsized":"2024-05-09T01:41:41.641259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:55.633143+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:44:55.633143+0000","last_peered":"2024-05-09T01:44:55.633143+0000","last_clean":"2024-05-09T01:44:55.633143+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:44:55.633143+0000","last_undegraded":"2024-05-09T01:44:55.633143+0000","last_fullsized":"2024-05-09T01:44:55.633143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.643818+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:41.643818+0000","last_peered":"2024-05-09T01:41:41.643818+0000","last_clean":"2024-05-09T01:41:41.643818+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:41.643818+0000","last_undegraded":"2024-05-09T01:41:41.643818+0000","last_fullsized":"2024-05-09T01:41:41.643818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.478811+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:44:57.478811+0000","last_peered":"2024-05-09T01:44:57.478811+0000","last_clean":"2024-05-09T01:44:57.478811+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:44:57.478811+0000","last_undegraded":"2024-05-09T01:44:57.478811+0000","last_fullsized":"2024-05-09T01:44:57.478811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.644016+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:41.644016+0000","last_peered":"2024-05-09T01:41:41.644016+0000","last_clean":"2024-05-09T01:41:41.644016+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:41.644016+0000","last_undegraded":"2024-05-09T01:41:41.644016+0000","last_fullsized":"2024-05-09T01:41:41.644016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.922959+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:44:56.922959+0000","last_peered":"2024-05-09T01:44:56.922959+0000","last_clean":"2024-05-09T01:44:56.922959+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:44:56.922959+0000","last_undegraded":"2024-05-09T01:44:56.922959+0000","last_fullsized":"2024-05-09T01:44:56.922959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:17.247367+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:43:17.247367+0000","last_peered":"2024-05-09T01:43:17.247367+0000","last_clean":"2024-05-09T01:43:17.247367+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:43:17.247367+0000","last_undegraded":"2024-05-09T01:43:17.247367+0000","last_fullsized":"2024-05-09T01:43:17.247367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'86","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.860190+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:44:56.860190+0000","last_peered":"2024-05-09T01:44:56.860190+0000","last_clean":"2024-05-09T01:44:56.860190+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:44:56.860190+0000","last_undegraded":"2024-05-09T01:44:56.860190+0000","last_fullsized":"2024-05-09T01:44:56.860190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'123","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.413724+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:44:57.413724+0000","last_peered":"2024-05-09T01:44:57.413724+0000","last_clean":"2024-05-09T01:44:57.413724+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:44:57.413724+0000","last_undegraded":"2024-05-09T01:44:57.413724+0000","last_fullsized":"2024-05-09T01:44:57.413724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.641590+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:41.641590+0000","last_peered":"2024-05-09T01:41:41.641590+0000","last_clean":"2024-05-09T01:41:41.641590+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:41.641590+0000","last_undegraded":"2024-05-09T01:41:41.641590+0000","last_fullsized":"2024-05-09T01:41:41.641590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'97","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.948336+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:44:56.948336+0000","last_peered":"2024-05-09T01:44:56.948336+0000","last_clean":"2024-05-09T01:44:56.948336+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:44:56.948336+0000","last_undegraded":"2024-05-09T01:44:56.948336+0000","last_fullsized":"2024-05-09T01:44:56.948336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'13","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:32.249360+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:43:32.249360+0000","last_peered":"2024-05-09T01:43:32.249360+0000","last_clean":"2024-05-09T01:43:32.249360+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:43:32.249360+0000","last_undegraded":"2024-05-09T01:43:32.249360+0000","last_fullsized":"2024-05-09T01:43:32.249360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.726107+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:44:57.726107+0000","last_peered":"2024-05-09T01:44:57.726107+0000","last_clean":"2024-05-09T01:44:57.726107+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:44:57.726107+0000","last_undegraded":"2024-05-09T01:44:57.726107+0000","last_fullsized":"2024-05-09T01:44:57.726107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:01.237161+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:43:01.237161+0000","last_peered":"2024-05-09T01:43:01.237161+0000","last_clean":"2024-05-09T01:43:01.237161+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:43:01.237161+0000","last_undegraded":"2024-05-09T01:43:01.237161+0000","last_fullsized":"2024-05-09T01:43:01.237161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'105","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.560862+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:44:57.560862+0000","last_peered":"2024-05-09T01:44:57.560862+0000","last_clean":"2024-05-09T01:44:57.560862+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:44:57.560862+0000","last_undegraded":"2024-05-09T01:44:57.560862+0000","last_fullsized":"2024-05-09T01:44:57.560862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:06.237347+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:43:06.237347+0000","last_peered":"2024-05-09T01:43:06.237347+0000","last_clean":"2024-05-09T01:43:06.237347+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:43:06.237347+0000","last_undegraded":"2024-05-09T01:43:06.237347+0000","last_fullsized":"2024-05-09T01:43:06.237347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10737418240,"num_objects":2560,"num_object_clones":0,"num_object_copies":5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6657,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21474836480,"data_stored":21474836480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6658,"ondisk_log_size":6658,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":192145,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":322,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":384290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3161428,"kb_used_data":3126092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91210412,"statfs":{"total":96636764160,"available":93399461888,"internally_reserved":0,"allocated":3201118208,"data_stored":3200932498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2063288,"kb_used_data":2027952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92308552,"statfs":{"total":96636764160,"available":94523957248,"internally_reserved":0,"allocated":2076622848,"data_stored":2076451546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3287836,"kb_used_data":3252500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91084004,"statfs":{"total":96636764160,"available":93270020096,"internally_reserved":0,"allocated":3330560000,"data_stored":3330367386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3124224,"kb_used_data":3084728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":91247616,"statfs":{"total":96636764160,"available":93437558784,"internally_reserved":0,"allocated":3158761472,"data_stored":3158582214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1866576,"kb_used_data":1827080,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92505264,"statfs":{"total":96636764160,"available":94725390336,"internally_reserved":0,"allocated":1870929920,"data_stored":1870747326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1764104,"kb_used_data":1728768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92607736,"statfs":{"total":96636764160,"available":94830321664,"internally_reserved":0,"allocated":1770258432,"data_stored":1770083457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2985356,"kb_used_data":2945860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":91386484,"statfs":{"total":96636764160,"available":93579759616,"internally_reserved":0,"allocated":3016560640,"data_stored":3016381455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3017476,"kb_used_data":2982140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91354364,"statfs":{"total":96636764160,"available":93546868736,"internally_reserved":0,"allocated":3053711360,"data_stored":3053540720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":185665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":185429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3015704576,"data_stored":3015704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1769996288,"data_stored":1769996288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1870659584,"data_stored":1870659584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3158310912,"data_stored":3158310912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3053453312,"data_stored":3053453312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3330277376,"data_stored":3330277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2076180480,"data_stored":2076180480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3200253952,"data_stored":3200253952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:45:15.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:45:15.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.680+0000 7fa1c3d86640 1 Processor -- start 2024-05-09T01:45:15.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.680+0000 7fa1c3d86640 1 -- start start 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.682+0000 7fa1c3d86640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.682+0000 7fa1c3d86640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa1bc0c84d0 0x7fa1bc0c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.682+0000 7fa1c3d86640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa1bc06cf60 0x7fa1bc06d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.682+0000 7fa1c3d86640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa1bc06d8b0 con 0x7fa1bc0c84d0 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.682+0000 7fa1c3d86640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa1bc15ade0 con 0x7fa1bc06cf60 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.682+0000 7fa1c3d86640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc06dad0 con 0x7fa1bc0ca530 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa1bc0c84d0 0x7fa1bc0c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa1bc0c84d0 0x7fa1bc0c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45206/0 (socket says 172.21.15.42:45206) 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 -- 172.21.15.42:0/3217941507 learned_addr learned my addr 172.21.15.42:0/3217941507 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1b22640 1 --2- 172.21.15.42:0/3217941507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c2323640 1 --2- 172.21.15.42:0/3217941507 >> v2:172.21.15.181:3300/0 conn(0x7fa1bc06cf60 0x7fa1bc06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 -- 172.21.15.42:0/3217941507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 msgr2=0x7fa1bc154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:15.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 --2- 172.21.15.42:0/3217941507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 -- 172.21.15.42:0/3217941507 >> v2:172.21.15.181:3300/0 conn(0x7fa1bc06cf60 msgr2=0x7fa1bc06d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:15.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 --2- 172.21.15.42:0/3217941507 >> v2:172.21.15.181:3300/0 conn(0x7fa1bc06cf60 0x7fa1bc06d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.683+0000 7fa1c1321640 1 -- 172.21.15.42:0/3217941507 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc15b080 con 0x7fa1bc0c84d0 2024-05-09T01:45:15.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.684+0000 7fa1c1321640 1 --2- 172.21.15.42:0/3217941507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc0c84d0 0x7fa1bc0c88e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc073660 tx=0x7fa1ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836b0611c145f5e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:15.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.685+0000 7fa1c0b20640 1 -- 172.21.15.42:0/3217941507 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac037070 con 0x7fa1bc0c84d0 2024-05-09T01:45:15.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.685+0000 7fa1c0b20640 1 -- 172.21.15.42:0/3217941507 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac032440 con 0x7fa1bc0c84d0 2024-05-09T01:45:15.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.685+0000 7fa1c0b20640 1 -- 172.21.15.42:0/3217941507 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac032810 con 0x7fa1bc0c84d0 2024-05-09T01:45:15.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.685+0000 7fa1c3d86640 1 -- 172.21.15.42:0/3217941507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc0c84d0 msgr2=0x7fa1bc0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.685+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/3217941507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc0c84d0 0x7fa1bc0c88e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc073660 tx=0x7fa1ac02a1e0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 -- 172.21.15.42:0/3217941507 shutdown_connections 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/3217941507 >> v2:172.21.15.181:3300/0 conn(0x7fa1bc06cf60 0x7fa1bc06d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/3217941507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc0c84d0 0x7fa1bc0c88e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/3217941507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 -- 172.21.15.42:0/3217941507 >> 172.21.15.42:0/3217941507 conn(0x7fa1bc06fad0 msgr2=0x7fa1bc071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 -- 172.21.15.42:0/3217941507 shutdown_connections 2024-05-09T01:45:15.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.686+0000 7fa1c3d86640 1 -- 172.21.15.42:0/3217941507 wait complete. 2024-05-09T01:45:15.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.688+0000 7fa1c3d86640 1 Processor -- start 2024-05-09T01:45:15.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.688+0000 7fa1c3d86640 1 -- start start 2024-05-09T01:45:15.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.689+0000 7fa1c3d86640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 0x7fa1bc0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.689+0000 7fa1c3d86640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c3d86640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc1479a0 0x7fa1bc1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c3d86640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc15b920 con 0x7fa1bc1479a0 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c3d86640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc15b640 con 0x7fa1bc06cf60 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c3d86640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc155270 con 0x7fa1bc0ca530 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1b22640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 0x7fa1bc0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1b22640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 0x7fa1bc0cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51018/0 (socket says 172.21.15.42:51018) 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1b22640 1 -- 172.21.15.42:0/2435765958 learned_addr learned my addr 172.21.15.42:0/2435765958 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c2323640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc1479a0 0x7fa1bc1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 -- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 msgr2=0x7fa1bc0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 0x7fa1bc0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 -- 172.21.15.42:0/2435765958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc1479a0 msgr2=0x7fa1bc1f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc1479a0 0x7fa1bc1f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 -- 172.21.15.42:0/2435765958 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc0ce520 con 0x7fa1bc0ca530 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1b22640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 0x7fa1bc0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.690+0000 7fa1c1321640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc146b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0c90a0 tx=0x7fa1ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.691+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac041020 con 0x7fa1bc0ca530 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.691+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac03d620 con 0x7fa1bc0ca530 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.691+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac037040 con 0x7fa1bc0ca530 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.691+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc1475c0 con 0x7fa1bc0ca530 2024-05-09T01:45:15.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.691+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc0cd7e0 con 0x7fa1bc0ca530 2024-05-09T01:45:15.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.692+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc15f060 con 0x7fa1bc0ca530 2024-05-09T01:45:15.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.693+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1ac044020 con 0x7fa1bc0ca530 2024-05-09T01:45:15.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.694+0000 7fa1b27fc640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa1a00762d0 0x7fa1a00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:15.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.694+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa1ac0b7ac0 con 0x7fa1bc0ca530 2024-05-09T01:45:15.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.694+0000 7fa1c1b22640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa1a00762d0 0x7fa1a00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:15.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.695+0000 7fa1c1b22640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa1a00762d0 0x7fa1a00787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009f50 tx=0x7fa1b8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:15.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:15.701+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1ac04b030 con 0x7fa1bc0ca530 2024-05-09T01:45:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.017+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1bc0ca310 con 0x7fa1a00762d0 2024-05-09T01:45:16.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.028+0000 7fa1b27fc640 1 -- 172.21.15.42:0/2435765958 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253845 (secure 0 0 0) 0x7fa1bc0ca310 con 0x7fa1a00762d0 2024-05-09T01:45:16.029 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:16.030 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa1a00762d0 msgr2=0x7fa1a00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa1a00762d0 0x7fa1a00787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009f50 tx=0x7fa1b8009190 comp rx=0 tx=0).stop 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 msgr2=0x7fa1bc146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc146b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0c90a0 tx=0x7fa1ac0046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 shutdown_connections 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa1a00762d0 0x7fa1a00787e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1bc1479a0 0x7fa1bc1f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1bc0ca530 0x7fa1bc146b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 --2- 172.21.15.42:0/2435765958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc06cf60 0x7fa1bc0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 >> 172.21.15.42:0/2435765958 conn(0x7fa1bc06fad0 msgr2=0x7fa1bc153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 shutdown_connections 2024-05-09T01:45:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.033+0000 7fa1c3d86640 1 -- 172.21.15.42:0/2435765958 wait complete. 2024-05-09T01:45:16.047 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-05-09T01:45:14.279646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10738200753,"num_objects":2661,"num_object_clones":0,"num_object_copies":5322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2661,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":7080,"num_write_kb":25167738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7017,"ondisk_log_size":7017,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21270288,"kb_used_data":20975120,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":733704432,"statfs":{"total":773094113280,"available":751313338368,"internally_reserved":0,"allocated":21478522880,"data_stored":21477086602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003487"},"pg_stats":[{"pgid":"3.3f","version":"23'100","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.140726+0000","last_change":"2024-05-09T01:41:41.348265+0000","last_active":"2024-05-09T01:44:57.140726+0000","last_peered":"2024-05-09T01:44:57.140726+0000","last_clean":"2024-05-09T01:44:57.140726+0000","last_became_active":"2024-05-09T01:41:41.347858+0000","last_became_peered":"2024-05-09T01:41:41.347858+0000","last_unstale":"2024-05-09T01:44:57.140726+0000","last_undegraded":"2024-05-09T01:44:57.140726+0000","last_fullsized":"2024-05-09T01:44:57.140726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.121897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"23'90","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.659423+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:44:57.659423+0000","last_peered":"2024-05-09T01:44:57.659423+0000","last_clean":"2024-05-09T01:44:57.659423+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:44:57.659423+0000","last_undegraded":"2024-05-09T01:44:57.659423+0000","last_fullsized":"2024-05-09T01:44:57.659423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'103","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.012787+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:44:57.012787+0000","last_peered":"2024-05-09T01:44:57.012787+0000","last_clean":"2024-05-09T01:44:57.012787+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:44:57.012787+0000","last_undegraded":"2024-05-09T01:44:57.012787+0000","last_fullsized":"2024-05-09T01:44:57.012787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'115","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.741472+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:44:57.741472+0000","last_peered":"2024-05-09T01:44:57.741472+0000","last_clean":"2024-05-09T01:44:57.741472+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:44:57.741472+0000","last_undegraded":"2024-05-09T01:44:57.741472+0000","last_fullsized":"2024-05-09T01:44:57.741472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'105","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.542755+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:44:57.542755+0000","last_peered":"2024-05-09T01:44:57.542755+0000","last_clean":"2024-05-09T01:44:57.542755+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:44:57.542755+0000","last_undegraded":"2024-05-09T01:44:57.542755+0000","last_fullsized":"2024-05-09T01:44:57.542755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'93","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.425184+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:44:57.425184+0000","last_peered":"2024-05-09T01:44:57.425184+0000","last_clean":"2024-05-09T01:44:57.425184+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:44:57.425184+0000","last_undegraded":"2024-05-09T01:44:57.425184+0000","last_fullsized":"2024-05-09T01:44:57.425184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'114","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.156044+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:44:57.156044+0000","last_peered":"2024-05-09T01:44:57.156044+0000","last_clean":"2024-05-09T01:44:57.156044+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:44:57.156044+0000","last_undegraded":"2024-05-09T01:44:57.156044+0000","last_fullsized":"2024-05-09T01:44:57.156044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'126","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.595872+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:44:57.595872+0000","last_peered":"2024-05-09T01:44:57.595872+0000","last_clean":"2024-05-09T01:44:57.595872+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:44:57.595872+0000","last_undegraded":"2024-05-09T01:44:57.595872+0000","last_fullsized":"2024-05-09T01:44:57.595872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.249110+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:44:57.249110+0000","last_peered":"2024-05-09T01:44:57.249110+0000","last_clean":"2024-05-09T01:44:57.249110+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:44:57.249110+0000","last_undegraded":"2024-05-09T01:44:57.249110+0000","last_fullsized":"2024-05-09T01:44:57.249110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.336714+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:44:57.336714+0000","last_peered":"2024-05-09T01:44:57.336714+0000","last_clean":"2024-05-09T01:44:57.336714+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:44:57.336714+0000","last_undegraded":"2024-05-09T01:44:57.336714+0000","last_fullsized":"2024-05-09T01:44:57.336714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'129","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.125217+0000","last_change":"2024-05-09T01:41:41.345044+0000","last_active":"2024-05-09T01:44:57.125217+0000","last_peered":"2024-05-09T01:44:57.125217+0000","last_clean":"2024-05-09T01:44:57.125217+0000","last_became_active":"2024-05-09T01:41:41.344652+0000","last_became_peered":"2024-05-09T01:41:41.344652+0000","last_unstale":"2024-05-09T01:44:57.125217+0000","last_undegraded":"2024-05-09T01:44:57.125217+0000","last_fullsized":"2024-05-09T01:44:57.125217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:09.272509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.260492+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:44:57.260492+0000","last_peered":"2024-05-09T01:44:57.260492+0000","last_clean":"2024-05-09T01:44:57.260492+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:44:57.260492+0000","last_undegraded":"2024-05-09T01:44:57.260492+0000","last_fullsized":"2024-05-09T01:44:57.260492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.064173+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:44:57.064173+0000","last_peered":"2024-05-09T01:44:57.064173+0000","last_clean":"2024-05-09T01:44:57.064173+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:44:57.064173+0000","last_undegraded":"2024-05-09T01:44:57.064173+0000","last_fullsized":"2024-05-09T01:44:57.064173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.253820+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:44:57.253820+0000","last_peered":"2024-05-09T01:44:57.253820+0000","last_clean":"2024-05-09T01:44:57.253820+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:44:57.253820+0000","last_undegraded":"2024-05-09T01:44:57.253820+0000","last_fullsized":"2024-05-09T01:44:57.253820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.397067+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:44:57.397067+0000","last_peered":"2024-05-09T01:44:57.397067+0000","last_clean":"2024-05-09T01:44:57.397067+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:44:57.397067+0000","last_undegraded":"2024-05-09T01:44:57.397067+0000","last_fullsized":"2024-05-09T01:44:57.397067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'102","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.871512+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:44:56.871512+0000","last_peered":"2024-05-09T01:44:56.871512+0000","last_clean":"2024-05-09T01:44:56.871512+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:44:56.871512+0000","last_undegraded":"2024-05-09T01:44:56.871512+0000","last_fullsized":"2024-05-09T01:44:56.871512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'96","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.053124+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:44:57.053124+0000","last_peered":"2024-05-09T01:44:57.053124+0000","last_clean":"2024-05-09T01:44:57.053124+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:44:57.053124+0000","last_undegraded":"2024-05-09T01:44:57.053124+0000","last_fullsized":"2024-05-09T01:44:57.053124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.723281+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:44:57.723281+0000","last_peered":"2024-05-09T01:44:57.723281+0000","last_clean":"2024-05-09T01:44:57.723281+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:44:57.723281+0000","last_undegraded":"2024-05-09T01:44:57.723281+0000","last_fullsized":"2024-05-09T01:44:57.723281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'116","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.552790+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:44:57.552790+0000","last_peered":"2024-05-09T01:44:57.552790+0000","last_clean":"2024-05-09T01:44:57.552790+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:44:57.552790+0000","last_undegraded":"2024-05-09T01:44:57.552790+0000","last_fullsized":"2024-05-09T01:44:57.552790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.391808+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:44:57.391808+0000","last_peered":"2024-05-09T01:44:57.391808+0000","last_clean":"2024-05-09T01:44:57.391808+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:44:57.391808+0000","last_undegraded":"2024-05-09T01:44:57.391808+0000","last_fullsized":"2024-05-09T01:44:57.391808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'91","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.655028+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:44:57.655028+0000","last_peered":"2024-05-09T01:44:57.655028+0000","last_clean":"2024-05-09T01:44:57.655028+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:44:57.655028+0000","last_undegraded":"2024-05-09T01:44:57.655028+0000","last_fullsized":"2024-05-09T01:44:57.655028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'113","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.544704+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:44:57.544704+0000","last_peered":"2024-05-09T01:44:57.544704+0000","last_clean":"2024-05-09T01:44:57.544704+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:44:57.544704+0000","last_undegraded":"2024-05-09T01:44:57.544704+0000","last_fullsized":"2024-05-09T01:44:57.544704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'90","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:55.698932+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:44:55.698932+0000","last_peered":"2024-05-09T01:44:55.698932+0000","last_clean":"2024-05-09T01:44:55.698932+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:44:55.698932+0000","last_undegraded":"2024-05-09T01:44:55.698932+0000","last_fullsized":"2024-05-09T01:44:55.698932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'125","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.575932+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:44:56.575932+0000","last_peered":"2024-05-09T01:44:56.575932+0000","last_clean":"2024-05-09T01:44:56.575932+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:44:56.575932+0000","last_undegraded":"2024-05-09T01:44:56.575932+0000","last_fullsized":"2024-05-09T01:44:56.575932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'94","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.357660+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:44:57.357660+0000","last_peered":"2024-05-09T01:44:57.357660+0000","last_clean":"2024-05-09T01:44:57.357660+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:44:57.357660+0000","last_undegraded":"2024-05-09T01:44:57.357660+0000","last_fullsized":"2024-05-09T01:44:57.357660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'135","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.525486+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:44:57.525486+0000","last_peered":"2024-05-09T01:44:57.525486+0000","last_clean":"2024-05-09T01:44:57.525486+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:44:57.525486+0000","last_undegraded":"2024-05-09T01:44:57.525486+0000","last_fullsized":"2024-05-09T01:44:57.525486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'98","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.325305+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:44:57.325305+0000","last_peered":"2024-05-09T01:44:57.325305+0000","last_clean":"2024-05-09T01:44:57.325305+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:44:57.325305+0000","last_undegraded":"2024-05-09T01:44:57.325305+0000","last_fullsized":"2024-05-09T01:44:57.325305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'94","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.399507+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:44:57.399507+0000","last_peered":"2024-05-09T01:44:57.399507+0000","last_clean":"2024-05-09T01:44:57.399507+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:44:57.399507+0000","last_undegraded":"2024-05-09T01:44:57.399507+0000","last_fullsized":"2024-05-09T01:44:57.399507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'83","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.510734+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:44:57.510734+0000","last_peered":"2024-05-09T01:44:57.510734+0000","last_clean":"2024-05-09T01:44:57.510734+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:44:57.510734+0000","last_undegraded":"2024-05-09T01:44:57.510734+0000","last_fullsized":"2024-05-09T01:44:57.510734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.396506+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:44:57.396506+0000","last_peered":"2024-05-09T01:44:57.396506+0000","last_clean":"2024-05-09T01:44:57.396506+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:44:57.396506+0000","last_undegraded":"2024-05-09T01:44:57.396506+0000","last_fullsized":"2024-05-09T01:44:57.396506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'90","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.681609+0000","last_change":"2024-05-09T01:41:41.644145+0000","last_active":"2024-05-09T01:44:57.681609+0000","last_peered":"2024-05-09T01:44:57.681609+0000","last_clean":"2024-05-09T01:44:57.681609+0000","last_became_active":"2024-05-09T01:41:41.643556+0000","last_became_peered":"2024-05-09T01:41:41.643556+0000","last_unstale":"2024-05-09T01:44:57.681609+0000","last_undegraded":"2024-05-09T01:44:57.681609+0000","last_fullsized":"2024-05-09T01:44:57.681609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:20.778053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'106","reported_seq":124,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.743126+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:44:57.743126+0000","last_peered":"2024-05-09T01:44:57.743126+0000","last_clean":"2024-05-09T01:44:57.743126+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:44:57.743126+0000","last_undegraded":"2024-05-09T01:44:57.743126+0000","last_fullsized":"2024-05-09T01:44:57.743126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'88","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.443284+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:44:56.443284+0000","last_peered":"2024-05-09T01:44:56.443284+0000","last_clean":"2024-05-09T01:44:56.443284+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:44:56.443284+0000","last_undegraded":"2024-05-09T01:44:56.443284+0000","last_fullsized":"2024-05-09T01:44:56.443284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.642593+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:41:41.642593+0000","last_peered":"2024-05-09T01:41:41.642593+0000","last_clean":"2024-05-09T01:41:41.642593+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:41:41.642593+0000","last_undegraded":"2024-05-09T01:41:41.642593+0000","last_fullsized":"2024-05-09T01:41:41.642593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'94","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.860452+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:44:56.860452+0000","last_peered":"2024-05-09T01:44:56.860452+0000","last_clean":"2024-05-09T01:44:56.860452+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:44:56.860452+0000","last_undegraded":"2024-05-09T01:44:56.860452+0000","last_fullsized":"2024-05-09T01:44:56.860452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.342371+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:41.342371+0000","last_peered":"2024-05-09T01:41:41.342371+0000","last_clean":"2024-05-09T01:41:41.342371+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:41.342371+0000","last_undegraded":"2024-05-09T01:41:41.342371+0000","last_fullsized":"2024-05-09T01:41:41.342371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.642318+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:41.642318+0000","last_peered":"2024-05-09T01:41:41.642318+0000","last_clean":"2024-05-09T01:41:41.642318+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:41.642318+0000","last_undegraded":"2024-05-09T01:41:41.642318+0000","last_fullsized":"2024-05-09T01:41:41.642318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'115","reported_seq":132,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.078328+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:44:57.078328+0000","last_peered":"2024-05-09T01:44:57.078328+0000","last_clean":"2024-05-09T01:44:57.078328+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:44:57.078328+0000","last_undegraded":"2024-05-09T01:44:57.078328+0000","last_fullsized":"2024-05-09T01:44:57.078328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343074+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:41.343074+0000","last_peered":"2024-05-09T01:41:41.343074+0000","last_clean":"2024-05-09T01:41:41.343074+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:41.343074+0000","last_undegraded":"2024-05-09T01:41:41.343074+0000","last_fullsized":"2024-05-09T01:41:41.343074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'104","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.317257+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:44:56.317257+0000","last_peered":"2024-05-09T01:44:56.317257+0000","last_clean":"2024-05-09T01:44:56.317257+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:44:56.317257+0000","last_undegraded":"2024-05-09T01:44:56.317257+0000","last_fullsized":"2024-05-09T01:44:56.317257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:27.240057+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:43:27.240057+0000","last_peered":"2024-05-09T01:43:27.240057+0000","last_clean":"2024-05-09T01:43:27.240057+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:43:27.240057+0000","last_undegraded":"2024-05-09T01:43:27.240057+0000","last_fullsized":"2024-05-09T01:43:27.240057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'157","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.788115+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:44:57.788115+0000","last_peered":"2024-05-09T01:44:57.788115+0000","last_clean":"2024-05-09T01:44:57.788115+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:44:57.788115+0000","last_undegraded":"2024-05-09T01:44:57.788115+0000","last_fullsized":"2024-05-09T01:44:57.788115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343467+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:41.343467+0000","last_peered":"2024-05-09T01:41:41.343467+0000","last_clean":"2024-05-09T01:41:41.343467+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:41.343467+0000","last_undegraded":"2024-05-09T01:41:41.343467+0000","last_fullsized":"2024-05-09T01:41:41.343467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'97","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.555326+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:44:57.555326+0000","last_peered":"2024-05-09T01:44:57.555326+0000","last_clean":"2024-05-09T01:44:57.555326+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:44:57.555326+0000","last_undegraded":"2024-05-09T01:44:57.555326+0000","last_fullsized":"2024-05-09T01:44:57.555326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:52.908396+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:43:52.908396+0000","last_peered":"2024-05-09T01:43:52.908396+0000","last_clean":"2024-05-09T01:43:52.908396+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:43:52.908396+0000","last_undegraded":"2024-05-09T01:43:52.908396+0000","last_fullsized":"2024-05-09T01:43:52.908396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.140178+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:44:57.140178+0000","last_peered":"2024-05-09T01:44:57.140178+0000","last_clean":"2024-05-09T01:44:57.140178+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:44:57.140178+0000","last_undegraded":"2024-05-09T01:44:57.140178+0000","last_fullsized":"2024-05-09T01:44:57.140178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'89","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.786258+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:44:57.786258+0000","last_peered":"2024-05-09T01:44:57.786258+0000","last_clean":"2024-05-09T01:44:57.786258+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:44:57.786258+0000","last_undegraded":"2024-05-09T01:44:57.786258+0000","last_fullsized":"2024-05-09T01:44:57.786258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184198,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'106","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.709212+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:44:56.709212+0000","last_peered":"2024-05-09T01:44:56.709212+0000","last_clean":"2024-05-09T01:44:56.709212+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:44:56.709212+0000","last_undegraded":"2024-05-09T01:44:56.709212+0000","last_fullsized":"2024-05-09T01:44:56.709212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.643078+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:41.643078+0000","last_peered":"2024-05-09T01:41:41.643078+0000","last_clean":"2024-05-09T01:41:41.643078+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:41.643078+0000","last_undegraded":"2024-05-09T01:41:41.643078+0000","last_fullsized":"2024-05-09T01:41:41.643078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.335096+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:44:57.335096+0000","last_peered":"2024-05-09T01:44:57.335096+0000","last_clean":"2024-05-09T01:44:57.335096+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:44:57.335096+0000","last_undegraded":"2024-05-09T01:44:57.335096+0000","last_fullsized":"2024-05-09T01:44:57.335096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343136+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:41.343136+0000","last_peered":"2024-05-09T01:41:41.343136+0000","last_clean":"2024-05-09T01:41:41.343136+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:41.343136+0000","last_undegraded":"2024-05-09T01:41:41.343136+0000","last_fullsized":"2024-05-09T01:41:41.343136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'109","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.163468+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:44:57.163468+0000","last_peered":"2024-05-09T01:44:57.163468+0000","last_clean":"2024-05-09T01:44:57.163468+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:44:57.163468+0000","last_undegraded":"2024-05-09T01:44:57.163468+0000","last_fullsized":"2024-05-09T01:44:57.163468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.342146+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:41.342146+0000","last_peered":"2024-05-09T01:41:41.342146+0000","last_clean":"2024-05-09T01:41:41.342146+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:41.342146+0000","last_undegraded":"2024-05-09T01:41:41.342146+0000","last_fullsized":"2024-05-09T01:41:41.342146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'119","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.362040+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:44:57.362040+0000","last_peered":"2024-05-09T01:44:57.362040+0000","last_clean":"2024-05-09T01:44:57.362040+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:44:57.362040+0000","last_undegraded":"2024-05-09T01:44:57.362040+0000","last_fullsized":"2024-05-09T01:44:57.362040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.339844+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:41.339844+0000","last_peered":"2024-05-09T01:41:41.339844+0000","last_clean":"2024-05-09T01:41:41.339844+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:41.339844+0000","last_undegraded":"2024-05-09T01:41:41.339844+0000","last_fullsized":"2024-05-09T01:41:41.339844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'137","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.209109+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:44:57.209109+0000","last_peered":"2024-05-09T01:44:57.209109+0000","last_clean":"2024-05-09T01:44:57.209109+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:44:57.209109+0000","last_undegraded":"2024-05-09T01:44:57.209109+0000","last_fullsized":"2024-05-09T01:44:57.209109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.344769+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:41.344769+0000","last_peered":"2024-05-09T01:41:41.344769+0000","last_clean":"2024-05-09T01:41:41.344769+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:41.344769+0000","last_undegraded":"2024-05-09T01:41:41.344769+0000","last_fullsized":"2024-05-09T01:41:41.344769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'100","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.249205+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:44:57.249205+0000","last_peered":"2024-05-09T01:44:57.249205+0000","last_clean":"2024-05-09T01:44:57.249205+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:44:57.249205+0000","last_undegraded":"2024-05-09T01:44:57.249205+0000","last_fullsized":"2024-05-09T01:44:57.249205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.340309+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:41.340309+0000","last_peered":"2024-05-09T01:41:41.340309+0000","last_clean":"2024-05-09T01:41:41.340309+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:41.340309+0000","last_undegraded":"2024-05-09T01:41:41.340309+0000","last_fullsized":"2024-05-09T01:41:41.340309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'92","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.027702+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:44:57.027702+0000","last_peered":"2024-05-09T01:44:57.027702+0000","last_clean":"2024-05-09T01:44:57.027702+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:44:57.027702+0000","last_undegraded":"2024-05-09T01:44:57.027702+0000","last_fullsized":"2024-05-09T01:44:57.027702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.644397+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:41.644397+0000","last_peered":"2024-05-09T01:41:41.644397+0000","last_clean":"2024-05-09T01:41:41.644397+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:41.644397+0000","last_undegraded":"2024-05-09T01:41:41.644397+0000","last_fullsized":"2024-05-09T01:41:41.644397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.869270+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:44:56.869270+0000","last_peered":"2024-05-09T01:44:56.869270+0000","last_clean":"2024-05-09T01:44:56.869270+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:44:56.869270+0000","last_undegraded":"2024-05-09T01:44:56.869270+0000","last_fullsized":"2024-05-09T01:44:56.869270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.340117+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:41:41.340117+0000","last_peered":"2024-05-09T01:41:41.340117+0000","last_clean":"2024-05-09T01:41:41.340117+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:41:41.340117+0000","last_undegraded":"2024-05-09T01:41:41.340117+0000","last_fullsized":"2024-05-09T01:41:41.340117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.695742+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:44:56.695742+0000","last_peered":"2024-05-09T01:44:56.695742+0000","last_clean":"2024-05-09T01:44:56.695742+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:44:56.695742+0000","last_undegraded":"2024-05-09T01:44:56.695742+0000","last_fullsized":"2024-05-09T01:44:56.695742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:42:47.243604+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:42:47.243604+0000","last_peered":"2024-05-09T01:42:47.243604+0000","last_clean":"2024-05-09T01:42:47.243604+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:42:47.243604+0000","last_undegraded":"2024-05-09T01:42:47.243604+0000","last_fullsized":"2024-05-09T01:42:47.243604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.237683+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:43:07.237683+0000","last_peered":"2024-05-09T01:43:07.237683+0000","last_clean":"2024-05-09T01:43:07.237683+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:43:07.237683+0000","last_undegraded":"2024-05-09T01:43:07.237683+0000","last_fullsized":"2024-05-09T01:43:07.237683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'106","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.552799+0000","last_change":"2024-05-09T01:41:41.345428+0000","last_active":"2024-05-09T01:44:57.552799+0000","last_peered":"2024-05-09T01:44:57.552799+0000","last_clean":"2024-05-09T01:44:57.552799+0000","last_became_active":"2024-05-09T01:41:41.345116+0000","last_became_peered":"2024-05-09T01:41:41.345116+0000","last_unstale":"2024-05-09T01:44:57.552799+0000","last_undegraded":"2024-05-09T01:44:57.552799+0000","last_fullsized":"2024-05-09T01:44:57.552799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:21.854442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:02.245378+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:43:02.245378+0000","last_peered":"2024-05-09T01:43:02.245378+0000","last_clean":"2024-05-09T01:43:02.245378+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:43:02.245378+0000","last_undegraded":"2024-05-09T01:43:02.245378+0000","last_fullsized":"2024-05-09T01:43:02.245378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'95","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.786634+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:44:57.786634+0000","last_peered":"2024-05-09T01:44:57.786634+0000","last_clean":"2024-05-09T01:44:57.786634+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:44:57.786634+0000","last_undegraded":"2024-05-09T01:44:57.786634+0000","last_fullsized":"2024-05-09T01:44:57.786634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'9","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:06.867384+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:44:06.867384+0000","last_peered":"2024-05-09T01:44:06.867384+0000","last_clean":"2024-05-09T01:44:06.867384+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:44:06.867384+0000","last_undegraded":"2024-05-09T01:44:06.867384+0000","last_fullsized":"2024-05-09T01:44:06.867384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.508611+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:44:57.508611+0000","last_peered":"2024-05-09T01:44:57.508611+0000","last_clean":"2024-05-09T01:44:57.508611+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:44:57.508611+0000","last_undegraded":"2024-05-09T01:44:57.508611+0000","last_fullsized":"2024-05-09T01:44:57.508611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.237668+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:43:07.237668+0000","last_peered":"2024-05-09T01:43:07.237668+0000","last_clean":"2024-05-09T01:43:07.237668+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:43:07.237668+0000","last_undegraded":"2024-05-09T01:43:07.237668+0000","last_fullsized":"2024-05-09T01:43:07.237668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'99","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.745935+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:44:57.745935+0000","last_peered":"2024-05-09T01:44:57.745935+0000","last_clean":"2024-05-09T01:44:57.745935+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:44:57.745935+0000","last_undegraded":"2024-05-09T01:44:57.745935+0000","last_fullsized":"2024-05-09T01:44:57.745935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:06.237964+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:43:06.237964+0000","last_peered":"2024-05-09T01:43:06.237964+0000","last_clean":"2024-05-09T01:43:06.237964+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:43:06.237964+0000","last_undegraded":"2024-05-09T01:43:06.237964+0000","last_fullsized":"2024-05-09T01:43:06.237964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'101","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.595412+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:44:57.595412+0000","last_peered":"2024-05-09T01:44:57.595412+0000","last_clean":"2024-05-09T01:44:57.595412+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:44:57.595412+0000","last_undegraded":"2024-05-09T01:44:57.595412+0000","last_fullsized":"2024-05-09T01:44:57.595412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.246226+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:43:07.246226+0000","last_peered":"2024-05-09T01:43:07.246226+0000","last_clean":"2024-05-09T01:43:07.246226+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:43:07.246226+0000","last_undegraded":"2024-05-09T01:43:07.246226+0000","last_fullsized":"2024-05-09T01:43:07.246226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'96","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.574741+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:44:57.574741+0000","last_peered":"2024-05-09T01:44:57.574741+0000","last_clean":"2024-05-09T01:44:57.574741+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:44:57.574741+0000","last_undegraded":"2024-05-09T01:44:57.574741+0000","last_fullsized":"2024-05-09T01:44:57.574741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'21","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:07.808155+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:44:07.808155+0000","last_peered":"2024-05-09T01:44:07.808155+0000","last_clean":"2024-05-09T01:44:07.808155+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:44:07.808155+0000","last_undegraded":"2024-05-09T01:44:07.808155+0000","last_fullsized":"2024-05-09T01:44:07.808155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'105","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.543297+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:44:57.543297+0000","last_peered":"2024-05-09T01:44:57.543297+0000","last_clean":"2024-05-09T01:44:57.543297+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:44:57.543297+0000","last_undegraded":"2024-05-09T01:44:57.543297+0000","last_fullsized":"2024-05-09T01:44:57.543297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343439+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:41.343439+0000","last_peered":"2024-05-09T01:41:41.343439+0000","last_clean":"2024-05-09T01:41:41.343439+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:41.343439+0000","last_undegraded":"2024-05-09T01:41:41.343439+0000","last_fullsized":"2024-05-09T01:41:41.343439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'111","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.907892+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:44:56.907892+0000","last_peered":"2024-05-09T01:44:56.907892+0000","last_clean":"2024-05-09T01:44:56.907892+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:44:56.907892+0000","last_undegraded":"2024-05-09T01:44:56.907892+0000","last_fullsized":"2024-05-09T01:44:56.907892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.641259+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:41.641259+0000","last_peered":"2024-05-09T01:41:41.641259+0000","last_clean":"2024-05-09T01:41:41.641259+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:41.641259+0000","last_undegraded":"2024-05-09T01:41:41.641259+0000","last_fullsized":"2024-05-09T01:41:41.641259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'101","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:55.633143+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:44:55.633143+0000","last_peered":"2024-05-09T01:44:55.633143+0000","last_clean":"2024-05-09T01:44:55.633143+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:44:55.633143+0000","last_undegraded":"2024-05-09T01:44:55.633143+0000","last_fullsized":"2024-05-09T01:44:55.633143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.643818+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:41.643818+0000","last_peered":"2024-05-09T01:41:41.643818+0000","last_clean":"2024-05-09T01:41:41.643818+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:41.643818+0000","last_undegraded":"2024-05-09T01:41:41.643818+0000","last_fullsized":"2024-05-09T01:41:41.643818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.478811+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:44:57.478811+0000","last_peered":"2024-05-09T01:44:57.478811+0000","last_clean":"2024-05-09T01:44:57.478811+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:44:57.478811+0000","last_undegraded":"2024-05-09T01:44:57.478811+0000","last_fullsized":"2024-05-09T01:44:57.478811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.644016+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:41.644016+0000","last_peered":"2024-05-09T01:41:41.644016+0000","last_clean":"2024-05-09T01:41:41.644016+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:41.644016+0000","last_undegraded":"2024-05-09T01:41:41.644016+0000","last_fullsized":"2024-05-09T01:41:41.644016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.922959+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:44:56.922959+0000","last_peered":"2024-05-09T01:44:56.922959+0000","last_clean":"2024-05-09T01:44:56.922959+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:44:56.922959+0000","last_undegraded":"2024-05-09T01:44:56.922959+0000","last_fullsized":"2024-05-09T01:44:56.922959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:17.247367+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:43:17.247367+0000","last_peered":"2024-05-09T01:43:17.247367+0000","last_clean":"2024-05-09T01:43:17.247367+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:43:17.247367+0000","last_undegraded":"2024-05-09T01:43:17.247367+0000","last_fullsized":"2024-05-09T01:43:17.247367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'86","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.860190+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:44:56.860190+0000","last_peered":"2024-05-09T01:44:56.860190+0000","last_clean":"2024-05-09T01:44:56.860190+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:44:56.860190+0000","last_undegraded":"2024-05-09T01:44:56.860190+0000","last_fullsized":"2024-05-09T01:44:56.860190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'123","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.413724+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:44:57.413724+0000","last_peered":"2024-05-09T01:44:57.413724+0000","last_clean":"2024-05-09T01:44:57.413724+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:44:57.413724+0000","last_undegraded":"2024-05-09T01:44:57.413724+0000","last_fullsized":"2024-05-09T01:44:57.413724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.641590+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:41.641590+0000","last_peered":"2024-05-09T01:41:41.641590+0000","last_clean":"2024-05-09T01:41:41.641590+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:41.641590+0000","last_undegraded":"2024-05-09T01:41:41.641590+0000","last_fullsized":"2024-05-09T01:41:41.641590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'97","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.948336+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:44:56.948336+0000","last_peered":"2024-05-09T01:44:56.948336+0000","last_clean":"2024-05-09T01:44:56.948336+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:44:56.948336+0000","last_undegraded":"2024-05-09T01:44:56.948336+0000","last_fullsized":"2024-05-09T01:44:56.948336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'13","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:32.249360+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:43:32.249360+0000","last_peered":"2024-05-09T01:43:32.249360+0000","last_clean":"2024-05-09T01:43:32.249360+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:43:32.249360+0000","last_undegraded":"2024-05-09T01:43:32.249360+0000","last_fullsized":"2024-05-09T01:43:32.249360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.726107+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:44:57.726107+0000","last_peered":"2024-05-09T01:44:57.726107+0000","last_clean":"2024-05-09T01:44:57.726107+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:44:57.726107+0000","last_undegraded":"2024-05-09T01:44:57.726107+0000","last_fullsized":"2024-05-09T01:44:57.726107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:01.237161+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:43:01.237161+0000","last_peered":"2024-05-09T01:43:01.237161+0000","last_clean":"2024-05-09T01:43:01.237161+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:43:01.237161+0000","last_undegraded":"2024-05-09T01:43:01.237161+0000","last_fullsized":"2024-05-09T01:43:01.237161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'105","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.560862+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:44:57.560862+0000","last_peered":"2024-05-09T01:44:57.560862+0000","last_clean":"2024-05-09T01:44:57.560862+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:44:57.560862+0000","last_undegraded":"2024-05-09T01:44:57.560862+0000","last_fullsized":"2024-05-09T01:44:57.560862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:06.237347+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:43:06.237347+0000","last_peered":"2024-05-09T01:43:06.237347+0000","last_clean":"2024-05-09T01:43:06.237347+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:43:06.237347+0000","last_undegraded":"2024-05-09T01:43:06.237347+0000","last_fullsized":"2024-05-09T01:43:06.237347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10737418240,"num_objects":2560,"num_object_clones":0,"num_object_copies":5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6657,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21474836480,"data_stored":21474836480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6658,"ondisk_log_size":6658,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":192145,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":322,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":384290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3161428,"kb_used_data":3126092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91210412,"statfs":{"total":96636764160,"available":93399461888,"internally_reserved":0,"allocated":3201118208,"data_stored":3200932498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2063288,"kb_used_data":2027952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92308552,"statfs":{"total":96636764160,"available":94523957248,"internally_reserved":0,"allocated":2076622848,"data_stored":2076451546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3287836,"kb_used_data":3252500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91084004,"statfs":{"total":96636764160,"available":93270020096,"internally_reserved":0,"allocated":3330560000,"data_stored":3330367386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3124224,"kb_used_data":3084728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":91247616,"statfs":{"total":96636764160,"available":93437558784,"internally_reserved":0,"allocated":3158761472,"data_stored":3158582214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1866576,"kb_used_data":1827080,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92505264,"statfs":{"total":96636764160,"available":94725390336,"internally_reserved":0,"allocated":1870929920,"data_stored":1870747326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1764104,"kb_used_data":1728768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92607736,"statfs":{"total":96636764160,"available":94830321664,"internally_reserved":0,"allocated":1770258432,"data_stored":1770083457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2985356,"kb_used_data":2945860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":91386484,"statfs":{"total":96636764160,"available":93579759616,"internally_reserved":0,"allocated":3016560640,"data_stored":3016381455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3017476,"kb_used_data":2982140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91354364,"statfs":{"total":96636764160,"available":93546868736,"internally_reserved":0,"allocated":3053711360,"data_stored":3053540720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":185665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":185429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3015704576,"data_stored":3015704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1769996288,"data_stored":1769996288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1870659584,"data_stored":1870659584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3158310912,"data_stored":3158310912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3053453312,"data_stored":3053453312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3330277376,"data_stored":3330277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2076180480,"data_stored":2076180480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3200253952,"data_stored":3200253952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:45:16.051 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T01:45:16.051 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.261+0000 7f67a649f640 1 Processor -- start 2024-05-09T01:45:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.262+0000 7f67a649f640 1 -- start start 2024-05-09T01:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a649f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f67a015d840 0x7f67a00c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a649f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67a00c8c70 0x7f67a00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a649f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a015dd30 con 0x7f67a00736a0 2024-05-09T01:45:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a649f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f67a0074a30 con 0x7f67a00c8c70 2024-05-09T01:45:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a649f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f67a0070d10 con 0x7f67a015d840 2024-05-09T01:45:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f67a015d840 0x7f67a00c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f67a015d840 0x7f67a00c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51028/0 (socket says 172.21.15.42:51028) 2024-05-09T01:45:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 -- 172.21.15.42:0/4219884613 learned_addr learned my addr 172.21.15.42:0/4219884613 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a4a3c640 1 --2- 172.21.15.42:0/4219884613 >> v2:172.21.15.42:3300/0 conn(0x7f67a00c8c70 0x7f67a00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 -- 172.21.15.42:0/4219884613 >> v2:172.21.15.42:3300/0 conn(0x7f67a00c8c70 msgr2=0x7f67a00707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 --2- 172.21.15.42:0/4219884613 >> v2:172.21.15.42:3300/0 conn(0x7f67a00c8c70 0x7f67a00707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 -- 172.21.15.42:0/4219884613 >> v1:172.21.15.181:6789/0 conn(0x7f67a00736a0 legacy=0x7f67a00700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f679ffff640 1 -- 172.21.15.42:0/4219884613 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a0073e20 con 0x7f67a015d840 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.264+0000 7f67a4a3c640 1 --2- 172.21.15.42:0/4219884613 >> v2:172.21.15.42:3300/0 conn(0x7f67a00c8c70 0x7f67a00707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.265+0000 7f679ffff640 1 --2- 172.21.15.42:0/4219884613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a015d840 0x7f67a00c8730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67a00cdd90 tx=0x7f679002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df27019cf71d43c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:16.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.266+0000 7f679effd640 1 -- 172.21.15.42:0/4219884613 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790037070 con 0x7f67a015d840 2024-05-09T01:45:16.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.266+0000 7f679effd640 1 -- 172.21.15.42:0/4219884613 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679002ae50 con 0x7f67a015d840 2024-05-09T01:45:16.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.266+0000 7f679effd640 1 -- 172.21.15.42:0/4219884613 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790032860 con 0x7f67a015d840 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 -- 172.21.15.42:0/4219884613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a015d840 msgr2=0x7f67a00c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 --2- 172.21.15.42:0/4219884613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a015d840 0x7f67a00c8730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67a00cdd90 tx=0x7f679002a300 comp rx=0 tx=0).stop 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 -- 172.21.15.42:0/4219884613 shutdown_connections 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 --2- 172.21.15.42:0/4219884613 >> v2:172.21.15.42:3300/0 conn(0x7f67a00c8c70 0x7f67a00707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 --2- 172.21.15.42:0/4219884613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a015d840 0x7f67a00c8730 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67a00cdd90 tx=0x7f679002a300 comp rx=0 tx=0).stop 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 -- 172.21.15.42:0/4219884613 >> 172.21.15.42:0/4219884613 conn(0x7f67a006cdc0 msgr2=0x7f67a00cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:16.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 -- 172.21.15.42:0/4219884613 shutdown_connections 2024-05-09T01:45:16.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.267+0000 7f67a649f640 1 -- 172.21.15.42:0/4219884613 wait complete. 2024-05-09T01:45:16.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.270+0000 7f67a649f640 1 Processor -- start 2024-05-09T01:45:16.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.270+0000 7f67a649f640 1 -- start start 2024-05-09T01:45:16.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a649f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 0x7f67a01f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a649f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a00c8c70 0x7f67a00c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a649f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a00c3770 0x7f67a00c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a649f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f67a00746c0 con 0x7f67a00736a0 2024-05-09T01:45:16.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a649f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f67a00743e0 con 0x7f67a00c3770 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a649f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f67a00c9080 con 0x7f67a00c8c70 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f679ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 0x7f67a01f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f67a4a3c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a00c3770 0x7f67a00c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f679f7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a00c8c70 0x7f67a00c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f679ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 0x7f67a01f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45226/0 (socket says 172.21.15.42:45226) 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.272+0000 7f679ffff640 1 -- 172.21.15.42:0/1260327072 learned_addr learned my addr 172.21.15.42:0/1260327072 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f67a4a3c640 1 -- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a00c8c70 msgr2=0x7f67a00c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f67a4a3c640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a00c8c70 0x7f67a00c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f67a4a3c640 1 -- 172.21.15.42:0/1260327072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 msgr2=0x7f67a01f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f67a4a3c640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 0x7f67a01f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f67a4a3c640 1 -- 172.21.15.42:0/1260327072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a01f47e0 con 0x7f67a00c3770 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f679ffff640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 0x7f67a01f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f67a4a3c640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a00c3770 0x7f67a00c3b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6798007d80 tx=0x7f679800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:16.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.273+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679801a070 con 0x7f67a00c3770 2024-05-09T01:45:16.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.274+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6798015400 con 0x7f67a00c3770 2024-05-09T01:45:16.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.274+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a01f3ae0 con 0x7f67a00c3770 2024-05-09T01:45:16.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.274+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67980157d0 con 0x7f67a00c3770 2024-05-09T01:45:16.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.274+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a00cc520 con 0x7f67a00c3770 2024-05-09T01:45:16.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.275+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a00cc760 con 0x7f67a00c3770 2024-05-09T01:45:16.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.277+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6798005d10 con 0x7f67a00c3770 2024-05-09T01:45:16.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.278+0000 7f679cff9640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f678c0762d0 0x7f678c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.279+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6798097bc0 con 0x7f67a00c3770 2024-05-09T01:45:16.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.279+0000 7f679ffff640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f678c0762d0 0x7f678c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.280+0000 7f679ffff640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f678c0762d0 0x7f678c0787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67900090b0 tx=0x7f679002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:16.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.282+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6798024080 con 0x7f67a00c3770 2024-05-09T01:45:16.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.535+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67a01f3930 con 0x7f678c0762d0 2024-05-09T01:45:16.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.547+0000 7f679cff9640 1 -- 172.21.15.42:0/1260327072 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253969 (secure 0 0 0) 0x7f67a01f3930 con 0x7f678c0762d0 2024-05-09T01:45:16.547 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:16.548 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f678c0762d0 msgr2=0x7f678c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f678c0762d0 0x7f678c0787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67900090b0 tx=0x7f679002e000 comp rx=0 tx=0).stop 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a00c3770 msgr2=0x7f67a00c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a00c3770 0x7f67a00c3b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6798007d80 tx=0x7f679800d4a0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 shutdown_connections 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f678c0762d0 0x7f678c0787e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a00c3770 0x7f67a00c3b80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a00c8c70 0x7f67a00c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 --2- 172.21.15.42:0/1260327072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67a00736a0 0x7f67a01f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.552+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 >> 172.21.15.42:0/1260327072 conn(0x7f67a006cdc0 msgr2=0x7f67a00c71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:16.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.553+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 shutdown_connections 2024-05-09T01:45:16.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.553+0000 7f67a649f640 1 -- 172.21.15.42:0/1260327072 wait complete. 2024-05-09T01:45:16.568 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-05-09T01:45:16.280002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7357592314,"num_objects":1855,"num_object_clones":0,"num_object_copies":3710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1855,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":7898,"num_write_kb":25167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8092,"ondisk_log_size":8092,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":18616096,"kb_used_data":18320928,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":736358624,"statfs":{"total":773094113280,"available":754031230976,"internally_reserved":0,"allocated":18760630272,"data_stored":18759194952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3380608439,"num_objects":-806,"num_object_clones":0,"num_object_copies":-1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-806,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":820,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003181"},"pg_stats":[{"pgid":"3.3f","version":"23'137","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.182487+0000","last_change":"2024-05-09T01:41:41.348265+0000","last_active":"2024-05-09T01:45:16.182487+0000","last_peered":"2024-05-09T01:45:16.182487+0000","last_clean":"2024-05-09T01:45:16.182487+0000","last_became_active":"2024-05-09T01:41:41.347858+0000","last_became_peered":"2024-05-09T01:41:41.347858+0000","last_unstale":"2024-05-09T01:45:16.182487+0000","last_undegraded":"2024-05-09T01:45:16.182487+0000","last_fullsized":"2024-05-09T01:45:16.182487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.121897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"23'120","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.158229+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:45:16.158229+0000","last_peered":"2024-05-09T01:45:16.158229+0000","last_clean":"2024-05-09T01:45:16.158229+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:45:16.158229+0000","last_undegraded":"2024-05-09T01:45:16.158229+0000","last_fullsized":"2024-05-09T01:45:16.158229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:01.414075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'141","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.226574+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:45:16.226574+0000","last_peered":"2024-05-09T01:45:16.226574+0000","last_clean":"2024-05-09T01:45:16.226574+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:45:16.226574+0000","last_undegraded":"2024-05-09T01:45:16.226574+0000","last_fullsized":"2024-05-09T01:45:16.226574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:05.314939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'115","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.741472+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:44:57.741472+0000","last_peered":"2024-05-09T01:44:57.741472+0000","last_clean":"2024-05-09T01:44:57.741472+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:44:57.741472+0000","last_undegraded":"2024-05-09T01:44:57.741472+0000","last_fullsized":"2024-05-09T01:44:57.741472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:23.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'105","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.542755+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:44:57.542755+0000","last_peered":"2024-05-09T01:44:57.542755+0000","last_clean":"2024-05-09T01:44:57.542755+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:44:57.542755+0000","last_undegraded":"2024-05-09T01:44:57.542755+0000","last_fullsized":"2024-05-09T01:44:57.542755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:08.021105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'93","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.425184+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:44:57.425184+0000","last_peered":"2024-05-09T01:44:57.425184+0000","last_clean":"2024-05-09T01:44:57.425184+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:44:57.425184+0000","last_undegraded":"2024-05-09T01:44:57.425184+0000","last_fullsized":"2024-05-09T01:44:57.425184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:36.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'114","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.156044+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:44:57.156044+0000","last_peered":"2024-05-09T01:44:57.156044+0000","last_clean":"2024-05-09T01:44:57.156044+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:44:57.156044+0000","last_undegraded":"2024-05-09T01:44:57.156044+0000","last_fullsized":"2024-05-09T01:44:57.156044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:25.962159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'167","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.133700+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:45:16.133700+0000","last_peered":"2024-05-09T01:45:16.133700+0000","last_clean":"2024-05-09T01:45:16.133700+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:45:16.133700+0000","last_undegraded":"2024-05-09T01:45:16.133700+0000","last_fullsized":"2024-05-09T01:45:16.133700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:30.592067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.249110+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:44:57.249110+0000","last_peered":"2024-05-09T01:44:57.249110+0000","last_clean":"2024-05-09T01:44:57.249110+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:44:57.249110+0000","last_undegraded":"2024-05-09T01:44:57.249110+0000","last_fullsized":"2024-05-09T01:44:57.249110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:24.217701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.336714+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:44:57.336714+0000","last_peered":"2024-05-09T01:44:57.336714+0000","last_clean":"2024-05-09T01:44:57.336714+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:44:57.336714+0000","last_undegraded":"2024-05-09T01:44:57.336714+0000","last_fullsized":"2024-05-09T01:44:57.336714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:21.198891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'129","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.125217+0000","last_change":"2024-05-09T01:41:41.345044+0000","last_active":"2024-05-09T01:44:57.125217+0000","last_peered":"2024-05-09T01:44:57.125217+0000","last_clean":"2024-05-09T01:44:57.125217+0000","last_became_active":"2024-05-09T01:41:41.344652+0000","last_became_peered":"2024-05-09T01:41:41.344652+0000","last_unstale":"2024-05-09T01:44:57.125217+0000","last_undegraded":"2024-05-09T01:44:57.125217+0000","last_fullsized":"2024-05-09T01:44:57.125217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:09.272509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'111","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.138431+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:45:15.138431+0000","last_peered":"2024-05-09T01:45:15.138431+0000","last_clean":"2024-05-09T01:45:15.138431+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:45:15.138431+0000","last_undegraded":"2024-05-09T01:45:15.138431+0000","last_fullsized":"2024-05-09T01:45:15.138431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'140","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.103456+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:45:16.103456+0000","last_peered":"2024-05-09T01:45:16.103456+0000","last_clean":"2024-05-09T01:45:16.103456+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:45:16.103456+0000","last_undegraded":"2024-05-09T01:45:16.103456+0000","last_fullsized":"2024-05-09T01:45:16.103456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:26.712181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'137","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.135293+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:45:16.135293+0000","last_peered":"2024-05-09T01:45:16.135293+0000","last_clean":"2024-05-09T01:45:16.135293+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:45:16.135293+0000","last_undegraded":"2024-05-09T01:45:16.135293+0000","last_fullsized":"2024-05-09T01:45:16.135293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:00.334120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'138","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.191336+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:45:16.191336+0000","last_peered":"2024-05-09T01:45:16.191336+0000","last_clean":"2024-05-09T01:45:16.191336+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:45:16.191336+0000","last_undegraded":"2024-05-09T01:45:16.191336+0000","last_fullsized":"2024-05-09T01:45:16.191336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:53.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'102","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.871512+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:44:56.871512+0000","last_peered":"2024-05-09T01:44:56.871512+0000","last_clean":"2024-05-09T01:44:56.871512+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:44:56.871512+0000","last_undegraded":"2024-05-09T01:44:56.871512+0000","last_fullsized":"2024-05-09T01:44:56.871512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:58.281199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'96","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.053124+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:44:57.053124+0000","last_peered":"2024-05-09T01:44:57.053124+0000","last_clean":"2024-05-09T01:44:57.053124+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:44:57.053124+0000","last_undegraded":"2024-05-09T01:44:57.053124+0000","last_fullsized":"2024-05-09T01:44:57.053124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:57.531658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'140","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.142583+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:45:16.142583+0000","last_peered":"2024-05-09T01:45:16.142583+0000","last_clean":"2024-05-09T01:45:16.142583+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:45:16.142583+0000","last_undegraded":"2024-05-09T01:45:16.142583+0000","last_fullsized":"2024-05-09T01:45:16.142583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:44.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'116","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.552790+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:44:57.552790+0000","last_peered":"2024-05-09T01:44:57.552790+0000","last_clean":"2024-05-09T01:44:57.552790+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:44:57.552790+0000","last_undegraded":"2024-05-09T01:44:57.552790+0000","last_fullsized":"2024-05-09T01:44:57.552790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:34.664505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.391808+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:44:57.391808+0000","last_peered":"2024-05-09T01:44:57.391808+0000","last_clean":"2024-05-09T01:44:57.391808+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:44:57.391808+0000","last_undegraded":"2024-05-09T01:44:57.391808+0000","last_fullsized":"2024-05-09T01:44:57.391808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:34.390271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'120","reported_seq":137,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.987404+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:45:15.987404+0000","last_peered":"2024-05-09T01:45:15.987404+0000","last_clean":"2024-05-09T01:45:15.987404+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:45:15.987404+0000","last_undegraded":"2024-05-09T01:45:15.987404+0000","last_fullsized":"2024-05-09T01:45:15.987404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:21.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'113","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.544704+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:44:57.544704+0000","last_peered":"2024-05-09T01:44:57.544704+0000","last_clean":"2024-05-09T01:44:57.544704+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:44:57.544704+0000","last_undegraded":"2024-05-09T01:44:57.544704+0000","last_fullsized":"2024-05-09T01:44:57.544704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:04.890080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'129","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.140340+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:45:16.140340+0000","last_peered":"2024-05-09T01:45:16.140340+0000","last_clean":"2024-05-09T01:45:16.140340+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:45:16.140340+0000","last_undegraded":"2024-05-09T01:45:16.140340+0000","last_fullsized":"2024-05-09T01:45:16.140340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:08.759076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'125","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.575932+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:44:56.575932+0000","last_peered":"2024-05-09T01:44:56.575932+0000","last_clean":"2024-05-09T01:44:56.575932+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:44:56.575932+0000","last_undegraded":"2024-05-09T01:44:56.575932+0000","last_fullsized":"2024-05-09T01:44:56.575932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:05.607184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'117","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.208334+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:45:16.208334+0000","last_peered":"2024-05-09T01:45:16.208334+0000","last_clean":"2024-05-09T01:45:16.208334+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:45:16.208334+0000","last_undegraded":"2024-05-09T01:45:16.208334+0000","last_fullsized":"2024-05-09T01:45:16.208334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:42.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'135","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.525486+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:44:57.525486+0000","last_peered":"2024-05-09T01:44:57.525486+0000","last_clean":"2024-05-09T01:44:57.525486+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:44:57.525486+0000","last_undegraded":"2024-05-09T01:44:57.525486+0000","last_fullsized":"2024-05-09T01:44:57.525486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:39.170458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'133","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.033592+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:45:16.033592+0000","last_peered":"2024-05-09T01:45:16.033592+0000","last_clean":"2024-05-09T01:45:16.033592+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:45:16.033592+0000","last_undegraded":"2024-05-09T01:45:16.033592+0000","last_fullsized":"2024-05-09T01:45:16.033592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:45.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'122","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.161274+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:45:16.161274+0000","last_peered":"2024-05-09T01:45:16.161274+0000","last_clean":"2024-05-09T01:45:16.161274+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:45:16.161274+0000","last_undegraded":"2024-05-09T01:45:16.161274+0000","last_fullsized":"2024-05-09T01:45:16.161274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.059575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'108","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.191274+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:45:16.191274+0000","last_peered":"2024-05-09T01:45:16.191274+0000","last_clean":"2024-05-09T01:45:16.191274+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:45:16.191274+0000","last_undegraded":"2024-05-09T01:45:16.191274+0000","last_fullsized":"2024-05-09T01:45:16.191274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.732612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.396506+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:44:57.396506+0000","last_peered":"2024-05-09T01:44:57.396506+0000","last_clean":"2024-05-09T01:44:57.396506+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:44:57.396506+0000","last_undegraded":"2024-05-09T01:44:57.396506+0000","last_fullsized":"2024-05-09T01:44:57.396506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:51.117660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'127","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.083806+0000","last_change":"2024-05-09T01:41:41.644145+0000","last_active":"2024-05-09T01:45:16.083806+0000","last_peered":"2024-05-09T01:45:16.083806+0000","last_clean":"2024-05-09T01:45:16.083806+0000","last_became_active":"2024-05-09T01:41:41.643556+0000","last_became_peered":"2024-05-09T01:41:41.643556+0000","last_unstale":"2024-05-09T01:45:16.083806+0000","last_undegraded":"2024-05-09T01:45:16.083806+0000","last_fullsized":"2024-05-09T01:45:16.083806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:20.778053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'106","reported_seq":124,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.743126+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:44:57.743126+0000","last_peered":"2024-05-09T01:44:57.743126+0000","last_clean":"2024-05-09T01:44:57.743126+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:44:57.743126+0000","last_undegraded":"2024-05-09T01:44:57.743126+0000","last_fullsized":"2024-05-09T01:44:57.743126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:26.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'105","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.241711+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:45:15.241711+0000","last_peered":"2024-05-09T01:45:15.241711+0000","last_clean":"2024-05-09T01:45:15.241711+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:45:15.241711+0000","last_undegraded":"2024-05-09T01:45:15.241711+0000","last_fullsized":"2024-05-09T01:45:15.241711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:31.240151+0000","last_change":"2024-05-09T01:40:58.749329+0000","last_active":"2024-05-09T01:43:31.240151+0000","last_peered":"2024-05-09T01:43:31.240151+0000","last_clean":"2024-05-09T01:43:31.240151+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:43:31.240151+0000","last_undegraded":"2024-05-09T01:43:31.240151+0000","last_fullsized":"2024-05-09T01:43:31.240151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:00.924719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'124","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.072613+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:45:16.072613+0000","last_peered":"2024-05-09T01:45:16.072613+0000","last_clean":"2024-05-09T01:45:16.072613+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:45:16.072613+0000","last_undegraded":"2024-05-09T01:45:16.072613+0000","last_fullsized":"2024-05-09T01:45:16.072613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.957345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.342371+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:41:41.342371+0000","last_peered":"2024-05-09T01:41:41.342371+0000","last_clean":"2024-05-09T01:41:41.342371+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:41:41.342371+0000","last_undegraded":"2024-05-09T01:41:41.342371+0000","last_fullsized":"2024-05-09T01:41:41.342371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:30.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.642318+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:41:41.642318+0000","last_peered":"2024-05-09T01:41:41.642318+0000","last_clean":"2024-05-09T01:41:41.642318+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:41:41.642318+0000","last_undegraded":"2024-05-09T01:41:41.642318+0000","last_fullsized":"2024-05-09T01:41:41.642318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:24.517898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'159","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.123869+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:45:16.123869+0000","last_peered":"2024-05-09T01:45:16.123869+0000","last_clean":"2024-05-09T01:45:16.123869+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:45:16.123869+0000","last_undegraded":"2024-05-09T01:45:16.123869+0000","last_fullsized":"2024-05-09T01:45:16.123869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:17:52.198871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343074+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:41:41.343074+0000","last_peered":"2024-05-09T01:41:41.343074+0000","last_clean":"2024-05-09T01:41:41.343074+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:41:41.343074+0000","last_undegraded":"2024-05-09T01:41:41.343074+0000","last_fullsized":"2024-05-09T01:41:41.343074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:35.726157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'144","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.119467+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:45:16.119467+0000","last_peered":"2024-05-09T01:45:16.119467+0000","last_clean":"2024-05-09T01:45:16.119467+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:45:16.119467+0000","last_undegraded":"2024-05-09T01:45:16.119467+0000","last_fullsized":"2024-05-09T01:45:16.119467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:59.840314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:27.240057+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:43:27.240057+0000","last_peered":"2024-05-09T01:43:27.240057+0000","last_clean":"2024-05-09T01:43:27.240057+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:43:27.240057+0000","last_undegraded":"2024-05-09T01:43:27.240057+0000","last_fullsized":"2024-05-09T01:43:27.240057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:01.996955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'157","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.788115+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:44:57.788115+0000","last_peered":"2024-05-09T01:44:57.788115+0000","last_clean":"2024-05-09T01:44:57.788115+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:44:57.788115+0000","last_undegraded":"2024-05-09T01:44:57.788115+0000","last_fullsized":"2024-05-09T01:44:57.788115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:10.791428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343467+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:41:41.343467+0000","last_peered":"2024-05-09T01:41:41.343467+0000","last_clean":"2024-05-09T01:41:41.343467+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:41:41.343467+0000","last_undegraded":"2024-05-09T01:41:41.343467+0000","last_fullsized":"2024-05-09T01:41:41.343467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:23.023915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'130","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.211568+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:45:16.211568+0000","last_peered":"2024-05-09T01:45:16.211568+0000","last_clean":"2024-05-09T01:45:16.211568+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:45:16.211568+0000","last_undegraded":"2024-05-09T01:45:16.211568+0000","last_fullsized":"2024-05-09T01:45:16.211568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:46.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:52.908396+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:43:52.908396+0000","last_peered":"2024-05-09T01:43:52.908396+0000","last_clean":"2024-05-09T01:43:52.908396+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:43:52.908396+0000","last_undegraded":"2024-05-09T01:43:52.908396+0000","last_fullsized":"2024-05-09T01:43:52.908396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:01.939300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'116","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.195416+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:45:15.195416+0000","last_peered":"2024-05-09T01:45:15.195416+0000","last_clean":"2024-05-09T01:45:15.195416+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:45:15.195416+0000","last_undegraded":"2024-05-09T01:45:15.195416+0000","last_fullsized":"2024-05-09T01:45:15.195416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'89","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.786258+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:44:57.786258+0000","last_peered":"2024-05-09T01:44:57.786258+0000","last_clean":"2024-05-09T01:44:57.786258+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:44:57.786258+0000","last_undegraded":"2024-05-09T01:44:57.786258+0000","last_fullsized":"2024-05-09T01:44:57.786258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:21.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184198,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'106","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.709212+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:44:56.709212+0000","last_peered":"2024-05-09T01:44:56.709212+0000","last_clean":"2024-05-09T01:44:56.709212+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:44:56.709212+0000","last_undegraded":"2024-05-09T01:44:56.709212+0000","last_fullsized":"2024-05-09T01:44:56.709212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:11.266314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.643078+0000","last_change":"2024-05-09T01:40:58.755917+0000","last_active":"2024-05-09T01:41:41.643078+0000","last_peered":"2024-05-09T01:41:41.643078+0000","last_clean":"2024-05-09T01:41:41.643078+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:41:41.643078+0000","last_undegraded":"2024-05-09T01:41:41.643078+0000","last_fullsized":"2024-05-09T01:41:41.643078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:11.565429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'145","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.197091+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:45:16.197091+0000","last_peered":"2024-05-09T01:45:16.197091+0000","last_clean":"2024-05-09T01:45:16.197091+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:45:16.197091+0000","last_undegraded":"2024-05-09T01:45:16.197091+0000","last_fullsized":"2024-05-09T01:45:16.197091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:55.670521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343136+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:41:41.343136+0000","last_peered":"2024-05-09T01:41:41.343136+0000","last_clean":"2024-05-09T01:41:41.343136+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:41:41.343136+0000","last_undegraded":"2024-05-09T01:41:41.343136+0000","last_fullsized":"2024-05-09T01:41:41.343136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:38.915880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'109","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.163468+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:44:57.163468+0000","last_peered":"2024-05-09T01:44:57.163468+0000","last_clean":"2024-05-09T01:44:57.163468+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:44:57.163468+0000","last_undegraded":"2024-05-09T01:44:57.163468+0000","last_fullsized":"2024-05-09T01:44:57.163468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:28.694736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.342146+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:41:41.342146+0000","last_peered":"2024-05-09T01:41:41.342146+0000","last_clean":"2024-05-09T01:41:41.342146+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:41:41.342146+0000","last_undegraded":"2024-05-09T01:41:41.342146+0000","last_fullsized":"2024-05-09T01:41:41.342146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:42.363188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'119","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.362040+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:44:57.362040+0000","last_peered":"2024-05-09T01:44:57.362040+0000","last_clean":"2024-05-09T01:44:57.362040+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:44:57.362040+0000","last_undegraded":"2024-05-09T01:44:57.362040+0000","last_fullsized":"2024-05-09T01:44:57.362040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:01.048741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.339844+0000","last_change":"2024-05-09T01:40:58.750248+0000","last_active":"2024-05-09T01:41:41.339844+0000","last_peered":"2024-05-09T01:41:41.339844+0000","last_clean":"2024-05-09T01:41:41.339844+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:41:41.339844+0000","last_undegraded":"2024-05-09T01:41:41.339844+0000","last_fullsized":"2024-05-09T01:41:41.339844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:26.433523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'137","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.209109+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:44:57.209109+0000","last_peered":"2024-05-09T01:44:57.209109+0000","last_clean":"2024-05-09T01:44:57.209109+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:44:57.209109+0000","last_undegraded":"2024-05-09T01:44:57.209109+0000","last_fullsized":"2024-05-09T01:44:57.209109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:23.600482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.344769+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:41.344769+0000","last_peered":"2024-05-09T01:41:41.344769+0000","last_clean":"2024-05-09T01:41:41.344769+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:41.344769+0000","last_undegraded":"2024-05-09T01:41:41.344769+0000","last_fullsized":"2024-05-09T01:41:41.344769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'100","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.249205+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:44:57.249205+0000","last_peered":"2024-05-09T01:44:57.249205+0000","last_clean":"2024-05-09T01:44:57.249205+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:44:57.249205+0000","last_undegraded":"2024-05-09T01:44:57.249205+0000","last_fullsized":"2024-05-09T01:44:57.249205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:06.657421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.340309+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:41:41.340309+0000","last_peered":"2024-05-09T01:41:41.340309+0000","last_clean":"2024-05-09T01:41:41.340309+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:41:41.340309+0000","last_undegraded":"2024-05-09T01:41:41.340309+0000","last_fullsized":"2024-05-09T01:41:41.340309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:29.024538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'92","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.027702+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:44:57.027702+0000","last_peered":"2024-05-09T01:44:57.027702+0000","last_clean":"2024-05-09T01:44:57.027702+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:44:57.027702+0000","last_undegraded":"2024-05-09T01:44:57.027702+0000","last_fullsized":"2024-05-09T01:44:57.027702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:25.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.644397+0000","last_change":"2024-05-09T01:40:58.752240+0000","last_active":"2024-05-09T01:41:41.644397+0000","last_peered":"2024-05-09T01:41:41.644397+0000","last_clean":"2024-05-09T01:41:41.644397+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:41:41.644397+0000","last_undegraded":"2024-05-09T01:41:41.644397+0000","last_fullsized":"2024-05-09T01:41:41.644397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:58.650713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'99","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.869270+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:44:56.869270+0000","last_peered":"2024-05-09T01:44:56.869270+0000","last_clean":"2024-05-09T01:44:56.869270+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:44:56.869270+0000","last_undegraded":"2024-05-09T01:44:56.869270+0000","last_fullsized":"2024-05-09T01:44:56.869270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:49.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:16.238118+0000","last_change":"2024-05-09T01:40:58.750123+0000","last_active":"2024-05-09T01:43:16.238118+0000","last_peered":"2024-05-09T01:43:16.238118+0000","last_clean":"2024-05-09T01:43:16.238118+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:43:16.238118+0000","last_undegraded":"2024-05-09T01:43:16.238118+0000","last_fullsized":"2024-05-09T01:43:16.238118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:14.793745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'103","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.695742+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:44:56.695742+0000","last_peered":"2024-05-09T01:44:56.695742+0000","last_clean":"2024-05-09T01:44:56.695742+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:44:56.695742+0000","last_undegraded":"2024-05-09T01:44:56.695742+0000","last_fullsized":"2024-05-09T01:44:56.695742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:02.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:42:47.243604+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:42:47.243604+0000","last_peered":"2024-05-09T01:42:47.243604+0000","last_clean":"2024-05-09T01:42:47.243604+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:42:47.243604+0000","last_undegraded":"2024-05-09T01:42:47.243604+0000","last_fullsized":"2024-05-09T01:42:47.243604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:38.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.237683+0000","last_change":"2024-05-09T01:40:58.750935+0000","last_active":"2024-05-09T01:43:07.237683+0000","last_peered":"2024-05-09T01:43:07.237683+0000","last_clean":"2024-05-09T01:43:07.237683+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:43:07.237683+0000","last_undegraded":"2024-05-09T01:43:07.237683+0000","last_fullsized":"2024-05-09T01:43:07.237683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:41.007376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'144","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.200754+0000","last_change":"2024-05-09T01:41:41.345428+0000","last_active":"2024-05-09T01:45:16.200754+0000","last_peered":"2024-05-09T01:45:16.200754+0000","last_clean":"2024-05-09T01:45:16.200754+0000","last_became_active":"2024-05-09T01:41:41.345116+0000","last_became_peered":"2024-05-09T01:41:41.345116+0000","last_unstale":"2024-05-09T01:45:16.200754+0000","last_undegraded":"2024-05-09T01:45:16.200754+0000","last_fullsized":"2024-05-09T01:45:16.200754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:21.854442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:02.245378+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:43:02.245378+0000","last_peered":"2024-05-09T01:43:02.245378+0000","last_clean":"2024-05-09T01:43:02.245378+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:43:02.245378+0000","last_undegraded":"2024-05-09T01:43:02.245378+0000","last_fullsized":"2024-05-09T01:43:02.245378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:50.701754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'121","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.171474+0000","last_change":"2024-05-09T01:40:59.754831+0000","last_active":"2024-05-09T01:45:16.171474+0000","last_peered":"2024-05-09T01:45:16.171474+0000","last_clean":"2024-05-09T01:45:16.171474+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:45:16.171474+0000","last_undegraded":"2024-05-09T01:45:16.171474+0000","last_fullsized":"2024-05-09T01:45:16.171474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:38.871584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'12","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.049002+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:45:15.049002+0000","last_peered":"2024-05-09T01:45:15.049002+0000","last_clean":"2024-05-09T01:45:15.049002+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:45:15.049002+0000","last_undegraded":"2024-05-09T01:45:15.049002+0000","last_fullsized":"2024-05-09T01:45:15.049002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:06.890823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'121","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.251270+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:45:16.251270+0000","last_peered":"2024-05-09T01:45:16.251270+0000","last_clean":"2024-05-09T01:45:16.251270+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:45:16.251270+0000","last_undegraded":"2024-05-09T01:45:16.251270+0000","last_fullsized":"2024-05-09T01:45:16.251270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:40.781905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.237668+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:43:07.237668+0000","last_peered":"2024-05-09T01:43:07.237668+0000","last_clean":"2024-05-09T01:43:07.237668+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:43:07.237668+0000","last_undegraded":"2024-05-09T01:43:07.237668+0000","last_fullsized":"2024-05-09T01:43:07.237668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'111","reported_seq":129,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.152919+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:45:15.152919+0000","last_peered":"2024-05-09T01:45:15.152919+0000","last_clean":"2024-05-09T01:45:15.152919+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:45:15.152919+0000","last_undegraded":"2024-05-09T01:45:15.152919+0000","last_fullsized":"2024-05-09T01:45:15.152919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:06.237964+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:43:06.237964+0000","last_peered":"2024-05-09T01:43:06.237964+0000","last_clean":"2024-05-09T01:43:06.237964+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:43:06.237964+0000","last_undegraded":"2024-05-09T01:43:06.237964+0000","last_fullsized":"2024-05-09T01:43:06.237964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:58:00.234200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'101","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.595412+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:44:57.595412+0000","last_peered":"2024-05-09T01:44:57.595412+0000","last_clean":"2024-05-09T01:44:57.595412+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:44:57.595412+0000","last_undegraded":"2024-05-09T01:44:57.595412+0000","last_fullsized":"2024-05-09T01:44:57.595412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:54.771109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:07.246226+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:43:07.246226+0000","last_peered":"2024-05-09T01:43:07.246226+0000","last_clean":"2024-05-09T01:43:07.246226+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:43:07.246226+0000","last_undegraded":"2024-05-09T01:43:07.246226+0000","last_fullsized":"2024-05-09T01:43:07.246226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:33.813108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'126","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.171907+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:45:16.171907+0000","last_peered":"2024-05-09T01:45:16.171907+0000","last_clean":"2024-05-09T01:45:16.171907+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:45:16.171907+0000","last_undegraded":"2024-05-09T01:45:16.171907+0000","last_fullsized":"2024-05-09T01:45:16.171907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:21.556986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'24","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:13.815250+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:45:13.815250+0000","last_peered":"2024-05-09T01:45:13.815250+0000","last_clean":"2024-05-09T01:45:13.815250+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:45:13.815250+0000","last_undegraded":"2024-05-09T01:45:13.815250+0000","last_fullsized":"2024-05-09T01:45:13.815250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:01.496393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'126","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.131403+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:45:16.131403+0000","last_peered":"2024-05-09T01:45:16.131403+0000","last_clean":"2024-05-09T01:45:16.131403+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:45:16.131403+0000","last_undegraded":"2024-05-09T01:45:16.131403+0000","last_fullsized":"2024-05-09T01:45:16.131403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:33.570960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.343439+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:41:41.343439+0000","last_peered":"2024-05-09T01:41:41.343439+0000","last_clean":"2024-05-09T01:41:41.343439+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:41:41.343439+0000","last_undegraded":"2024-05-09T01:41:41.343439+0000","last_fullsized":"2024-05-09T01:41:41.343439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:39.637300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'153","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.217792+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:45:16.217792+0000","last_peered":"2024-05-09T01:45:16.217792+0000","last_clean":"2024-05-09T01:45:16.217792+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:45:16.217792+0000","last_undegraded":"2024-05-09T01:45:16.217792+0000","last_fullsized":"2024-05-09T01:45:16.217792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:41.711510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.641259+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:41:41.641259+0000","last_peered":"2024-05-09T01:41:41.641259+0000","last_clean":"2024-05-09T01:41:41.641259+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:41:41.641259+0000","last_undegraded":"2024-05-09T01:41:41.641259+0000","last_fullsized":"2024-05-09T01:41:41.641259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:03.715093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'108","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.241624+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:45:15.241624+0000","last_peered":"2024-05-09T01:45:15.241624+0000","last_clean":"2024-05-09T01:45:15.241624+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:45:15.241624+0000","last_undegraded":"2024-05-09T01:45:15.241624+0000","last_fullsized":"2024-05-09T01:45:15.241624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.643818+0000","last_change":"2024-05-09T01:40:58.750785+0000","last_active":"2024-05-09T01:41:41.643818+0000","last_peered":"2024-05-09T01:41:41.643818+0000","last_clean":"2024-05-09T01:41:41.643818+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:41:41.643818+0000","last_undegraded":"2024-05-09T01:41:41.643818+0000","last_fullsized":"2024-05-09T01:41:41.643818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:53.177398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'138","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.230346+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:45:16.230346+0000","last_peered":"2024-05-09T01:45:16.230346+0000","last_clean":"2024-05-09T01:45:16.230346+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:45:16.230346+0000","last_undegraded":"2024-05-09T01:45:16.230346+0000","last_fullsized":"2024-05-09T01:45:16.230346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:30.227987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.644016+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:41:41.644016+0000","last_peered":"2024-05-09T01:41:41.644016+0000","last_clean":"2024-05-09T01:41:41.644016+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:41:41.644016+0000","last_undegraded":"2024-05-09T01:41:41.644016+0000","last_fullsized":"2024-05-09T01:41:41.644016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:18.504058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'133","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.163329+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:45:16.163329+0000","last_peered":"2024-05-09T01:45:16.163329+0000","last_clean":"2024-05-09T01:45:16.163329+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:45:16.163329+0000","last_undegraded":"2024-05-09T01:45:16.163329+0000","last_fullsized":"2024-05-09T01:45:16.163329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:56:43.728464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:17.247367+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:43:17.247367+0000","last_peered":"2024-05-09T01:43:17.247367+0000","last_clean":"2024-05-09T01:43:17.247367+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:43:17.247367+0000","last_undegraded":"2024-05-09T01:43:17.247367+0000","last_fullsized":"2024-05-09T01:43:17.247367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.620575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'86","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.860190+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:44:56.860190+0000","last_peered":"2024-05-09T01:44:56.860190+0000","last_clean":"2024-05-09T01:44:56.860190+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:44:56.860190+0000","last_undegraded":"2024-05-09T01:44:56.860190+0000","last_fullsized":"2024-05-09T01:44:56.860190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:40.805074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'123","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:57.413724+0000","last_change":"2024-05-09T01:40:59.754124+0000","last_active":"2024-05-09T01:44:57.413724+0000","last_peered":"2024-05-09T01:44:57.413724+0000","last_clean":"2024-05-09T01:44:57.413724+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:44:57.413724+0000","last_undegraded":"2024-05-09T01:44:57.413724+0000","last_fullsized":"2024-05-09T01:44:57.413724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:25.940308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.641590+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:41:41.641590+0000","last_peered":"2024-05-09T01:41:41.641590+0000","last_clean":"2024-05-09T01:41:41.641590+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:41:41.641590+0000","last_undegraded":"2024-05-09T01:41:41.641590+0000","last_fullsized":"2024-05-09T01:41:41.641590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:46.167458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'97","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:56.948336+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:44:56.948336+0000","last_peered":"2024-05-09T01:44:56.948336+0000","last_clean":"2024-05-09T01:44:56.948336+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:44:56.948336+0000","last_undegraded":"2024-05-09T01:44:56.948336+0000","last_fullsized":"2024-05-09T01:44:56.948336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:24:52.505002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'13","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:32.249360+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:43:32.249360+0000","last_peered":"2024-05-09T01:43:32.249360+0000","last_clean":"2024-05-09T01:43:32.249360+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:43:32.249360+0000","last_undegraded":"2024-05-09T01:43:32.249360+0000","last_fullsized":"2024-05-09T01:43:32.249360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:44.833280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'120","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.194602+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:45:16.194602+0000","last_peered":"2024-05-09T01:45:16.194602+0000","last_clean":"2024-05-09T01:45:16.194602+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:45:16.194602+0000","last_undegraded":"2024-05-09T01:45:16.194602+0000","last_fullsized":"2024-05-09T01:45:16.194602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:43.398517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:01.237161+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:43:01.237161+0000","last_peered":"2024-05-09T01:43:01.237161+0000","last_clean":"2024-05-09T01:43:01.237161+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:43:01.237161+0000","last_undegraded":"2024-05-09T01:43:01.237161+0000","last_fullsized":"2024-05-09T01:43:01.237161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:55.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'134","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.193622+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:45:16.193622+0000","last_peered":"2024-05-09T01:45:16.193622+0000","last_clean":"2024-05-09T01:45:16.193622+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:45:16.193622+0000","last_undegraded":"2024-05-09T01:45:16.193622+0000","last_fullsized":"2024-05-09T01:45:16.193622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.853374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:06.237347+0000","last_change":"2024-05-09T01:40:58.755504+0000","last_active":"2024-05-09T01:43:06.237347+0000","last_peered":"2024-05-09T01:43:06.237347+0000","last_clean":"2024-05-09T01:43:06.237347+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:43:06.237347+0000","last_undegraded":"2024-05-09T01:43:06.237347+0000","last_fullsized":"2024-05-09T01:43:06.237347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:57.296147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7356809216,"num_objects":1754,"num_object_clones":0,"num_object_copies":3508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7463,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14185136128,"data_stored":14185136128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7725,"ondisk_log_size":7725,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":192730,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":334,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":401773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":295,"ondisk_log_size":295,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3161428,"kb_used_data":3126092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91210412,"statfs":{"total":96636764160,"available":93399461888,"internally_reserved":0,"allocated":3201118208,"data_stored":3200932498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2063288,"kb_used_data":2027952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92308552,"statfs":{"total":96636764160,"available":94523957248,"internally_reserved":0,"allocated":2076622848,"data_stored":2076451546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3287836,"kb_used_data":3252500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91084004,"statfs":{"total":96636764160,"available":93270020096,"internally_reserved":0,"allocated":3330560000,"data_stored":3330367386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2477072,"kb_used_data":2437576,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":91894768,"statfs":{"total":96636764160,"available":94100242432,"internally_reserved":0,"allocated":2496077824,"data_stored":2495899080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1129296,"kb_used_data":1089800,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93242544,"statfs":{"total":96636764160,"available":95480365056,"internally_reserved":0,"allocated":1115955200,"data_stored":1115773050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1280776,"kb_used_data":1245440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93091064,"statfs":{"total":96636764160,"available":95325249536,"internally_reserved":0,"allocated":1275330560,"data_stored":1275155585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2198924,"kb_used_data":2159428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92172916,"statfs":{"total":96636764160,"available":94385065984,"internally_reserved":0,"allocated":2211254272,"data_stored":2211075087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3017476,"kb_used_data":2982140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":91354364,"statfs":{"total":96636764160,"available":93546868736,"internally_reserved":0,"allocated":3053711360,"data_stored":3053540720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":202563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":185429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":905969664,"data_stored":905969664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532676608,"data_stored":532676608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":562036736,"data_stored":562036736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1044381696,"data_stored":1044381696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2533359616,"data_stored":2533359616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3330277376,"data_stored":3330277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2076180480,"data_stored":2076180480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3200253952,"data_stored":3200253952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:45:16.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:45:16.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.787+0000 7f1ed63c7640 1 Processor -- start 2024-05-09T01:45:16.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.787+0000 7f1ed63c7640 1 -- start start 2024-05-09T01:45:16.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.788+0000 7f1ed63c7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed0069c80 0x7f1ed0156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.788+0000 7f1ed63c7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ed00cdc20 0x7f1ed00c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.788+0000 7f1ed63c7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed00caae0 con 0x7f1ed00c56b0 2024-05-09T01:45:16.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.788+0000 7f1ed63c7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed00c8bb0 con 0x7f1ed00cdc20 2024-05-09T01:45:16.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.788+0000 7f1ed63c7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed01567d0 con 0x7f1ed0069c80 2024-05-09T01:45:16.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed0069c80 0x7f1ed0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ecf7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1ed00c56b0 0x7f1ed00708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34996/0 (socket says 172.21.15.42:34996) 2024-05-09T01:45:16.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ecf7fe640 1 -- 172.21.15.42:0/12152912 learned_addr learned my addr 172.21.15.42:0/12152912 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:16.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ed4964640 1 --2- 172.21.15.42:0/12152912 >> v2:172.21.15.181:3300/0 conn(0x7f1ed00cdc20 0x7f1ed00c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1eceffd640 1 -- 172.21.15.42:0/12152912 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725456200 0 0) 0x7f1ed00caae0 con 0x7f1ed00c56b0 2024-05-09T01:45:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1eceffd640 1 -- 172.21.15.42:0/12152912 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eb8003520 con 0x7f1ed00c56b0 2024-05-09T01:45:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ed4964640 1 -- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed0069c80 msgr2=0x7f1ed0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ed4964640 1 --2- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed0069c80 0x7f1ed0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ed4964640 1 -- 172.21.15.42:0/12152912 >> v1:172.21.15.42:6789/0 conn(0x7f1ed00c56b0 legacy=0x7f1ed00708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ed4964640 1 -- 172.21.15.42:0/12152912 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed0158f30 con 0x7f1ed00cdc20 2024-05-09T01:45:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.789+0000 7f1ecffff640 1 --2- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed0069c80 0x7f1ed0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.790+0000 7f1ed4964640 1 --2- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00cdc20 0x7f1ed00c9040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00097a0 tx=0x7f1ec002a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75b519efb2a1105c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.790+0000 7f1eceffd640 1 -- 172.21.15.42:0/12152912 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0037070 con 0x7f1ed00cdc20 2024-05-09T01:45:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.790+0000 7f1eceffd640 1 -- 172.21.15.42:0/12152912 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec002ae30 con 0x7f1ed00cdc20 2024-05-09T01:45:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.790+0000 7f1eceffd640 1 -- 172.21.15.42:0/12152912 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0032640 con 0x7f1ed00cdc20 2024-05-09T01:45:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 -- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00cdc20 msgr2=0x7f1ed00c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00cdc20 0x7f1ed00c9040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00097a0 tx=0x7f1ec002a0e0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 -- 172.21.15.42:0/12152912 shutdown_connections 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00cdc20 0x7f1ed00c9040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/12152912 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed0069c80 0x7f1ed0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 -- 172.21.15.42:0/12152912 >> 172.21.15.42:0/12152912 conn(0x7f1ed006ca60 msgr2=0x7f1ed006ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 -- 172.21.15.42:0/12152912 shutdown_connections 2024-05-09T01:45:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.792+0000 7f1ed63c7640 1 -- 172.21.15.42:0/12152912 wait complete. 2024-05-09T01:45:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.794+0000 7f1ed63c7640 1 Processor -- start 2024-05-09T01:45:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.794+0000 7f1ed63c7640 1 -- start start 2024-05-09T01:45:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed63c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ed0069c80 0x7f1ed0073630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed63c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00c56b0 0x7f1ed01495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed63c7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 0x7f1ed0151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed63c7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed01597d0 con 0x7f1ed0069c80 2024-05-09T01:45:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed63c7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed01594f0 con 0x7f1ed00c56b0 2024-05-09T01:45:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed63c7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed0159ab0 con 0x7f1ed00cdc20 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed4964640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 0x7f1ed0151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed4964640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 0x7f1ed0151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:40738/0 (socket says 172.21.15.42:40738) 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ed4964640 1 -- 172.21.15.42:0/1022539890 learned_addr learned my addr 172.21.15.42:0/1022539890 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ecf7fe640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00c56b0 0x7f1ed01495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.797+0000 7f1ecffff640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ed0069c80 0x7f1ed0073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed4964640 1 -- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00c56b0 msgr2=0x7f1ed01495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed4964640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00c56b0 0x7f1ed01495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed4964640 1 -- 172.21.15.42:0/1022539890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ed0069c80 msgr2=0x7f1ed0073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed4964640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ed0069c80 0x7f1ed0073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed4964640 1 -- 172.21.15.42:0/1022539890 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed01f2fe0 con 0x7f1ed00cdc20 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ecffff640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ed0069c80 0x7f1ed0073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed4964640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 0x7f1ed0151f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ec002a120 tx=0x7f1ec00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0041030 con 0x7f1ed00cdc20 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec002ac30 con 0x7f1ed00cdc20 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.798+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed01f32c0 con 0x7f1ed00cdc20 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.799+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed01f3880 con 0x7f1ed00cdc20 2024-05-09T01:45:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.799+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0037040 con 0x7f1ed00cdc20 2024-05-09T01:45:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.801+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed0158bb0 con 0x7f1ed00cdc20 2024-05-09T01:45:16.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.802+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ec0044070 con 0x7f1ed00cdc20 2024-05-09T01:45:16.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.803+0000 7f1eccff9640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1ebc0763d0 0x7f1ebc0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:16.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.803+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1ec00b7c60 con 0x7f1ed00cdc20 2024-05-09T01:45:16.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.803+0000 7f1ecffff640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1ebc0763d0 0x7f1ebc0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:16.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.804+0000 7f1ecffff640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1ebc0763d0 0x7f1ebc0788e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009a20 tx=0x7f1ec4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:16.811+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ec0081490 con 0x7f1ed00cdc20 2024-05-09T01:45:17.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.029+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ed00cc3c0 con 0x7f1ed00cdc20 2024-05-09T01:45:17.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.030+0000 7f1eccff9640 1 -- 172.21.15.42:0/1022539890 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16794 (secure 0 0 0) 0x7f1ec0080d90 con 0x7f1ed00cdc20 2024-05-09T01:45:17.028 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:17.028 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:41.333745+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1ebc0763d0 msgr2=0x7f1ebc0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1ebc0763d0 0x7f1ebc0788e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009a20 tx=0x7f1ec4008040 comp rx=0 tx=0).stop 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 msgr2=0x7f1ed0151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 0x7f1ed0151f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ec002a120 tx=0x7f1ec00046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 shutdown_connections 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f1ebc0763d0 0x7f1ebc0788e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ed00cdc20 0x7f1ed0151f60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ed00c56b0 0x7f1ed01495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 --2- 172.21.15.42:0/1022539890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ed0069c80 0x7f1ed0073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.032+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 >> 172.21.15.42:0/1022539890 conn(0x7f1ed006ca60 msgr2=0x7f1ed00ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.033+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 shutdown_connections 2024-05-09T01:45:17.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:17.033+0000 7f1ed63c7640 1 -- 172.21.15.42:0/1022539890 wait complete. 2024-05-09T01:45:18.043 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T01:45:18.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.169+0000 7fa6115e0640 1 Processor -- start 2024-05-09T01:45:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.169+0000 7fa6115e0640 1 -- start start 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa6115e0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0b4e90 0x7fa60c0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa6115e0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa60c1656f0 0x7fa60c167b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa6115e0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c15cf90 con 0x7fa60c0c7780 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa6115e0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa60c0ce890 con 0x7fa60c1656f0 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa6115e0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c0ccbc0 con 0x7fa60c0b4e90 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa60c1656f0 0x7fa60c167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa60c1656f0 0x7fa60c167b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53318/0 (socket says 172.21.15.42:53318) 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60affd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa60c0c7780 0x7fa60c06d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57316/0 (socket says 172.21.15.42:57316) 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 -- 172.21.15.42:0/1780463099 learned_addr learned my addr 172.21.15.42:0/1780463099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60a7fc640 1 --2- 172.21.15.42:0/1780463099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0b4e90 0x7fa60c0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 -- 172.21.15.42:0/1780463099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0b4e90 msgr2=0x7fa60c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:18.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 --2- 172.21.15.42:0/1780463099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0b4e90 0x7fa60c0cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 -- 172.21.15.42:0/1780463099 >> v1:172.21.15.42:6789/0 conn(0x7fa60c0c7780 legacy=0x7fa60c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa60b7fe640 1 -- 172.21.15.42:0/1780463099 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c0cce10 con 0x7fa60c1656f0 2024-05-09T01:45:18.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.171+0000 7fa609ffb640 1 -- 172.21.15.42:0/1780463099 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962591042 0 0) 0x7fa60c15cf90 con 0x7fa60c0c7780 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.172+0000 7fa60b7fe640 1 --2- 172.21.15.42:0/1780463099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c1656f0 0x7fa60c167b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa60402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03fc8ac5623ad77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.172+0000 7fa609ffb640 1 -- 172.21.15.42:0/1780463099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604036070 con 0x7fa60c1656f0 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.172+0000 7fa609ffb640 1 -- 172.21.15.42:0/1780463099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa604031600 con 0x7fa60c1656f0 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.172+0000 7fa609ffb640 1 -- 172.21.15.42:0/1780463099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6040319d0 con 0x7fa60c1656f0 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 -- 172.21.15.42:0/1780463099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c1656f0 msgr2=0x7fa60c167b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 --2- 172.21.15.42:0/1780463099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c1656f0 0x7fa60c167b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa60402a680 comp rx=0 tx=0).stop 2024-05-09T01:45:18.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 -- 172.21.15.42:0/1780463099 shutdown_connections 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 --2- 172.21.15.42:0/1780463099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c1656f0 0x7fa60c167b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 --2- 172.21.15.42:0/1780463099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0b4e90 0x7fa60c0cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 -- 172.21.15.42:0/1780463099 >> 172.21.15.42:0/1780463099 conn(0x7fa60c068e00 msgr2=0x7fa60c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 -- 172.21.15.42:0/1780463099 shutdown_connections 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.173+0000 7fa6115e0640 1 -- 172.21.15.42:0/1780463099 wait complete. 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.175+0000 7fa6115e0640 1 Processor -- start 2024-05-09T01:45:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.175+0000 7fa6115e0640 1 -- start start 2024-05-09T01:45:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa6115e0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c0b4e90 0x7fa60c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa6115e0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0c7780 0x7fa60c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa6115e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c1656f0 0x7fa60c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa6115e0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c0ce530 con 0x7fa60c0b4e90 2024-05-09T01:45:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa6115e0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c0cd460 con 0x7fa60c1656f0 2024-05-09T01:45:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa6115e0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c157350 con 0x7fa60c0c7780 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c0b4e90 0x7fa60c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c0b4e90 0x7fa60c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53330/0 (socket says 172.21.15.42:53330) 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 -- 172.21.15.42:0/43398768 learned_addr learned my addr 172.21.15.42:0/43398768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60a7fc640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0c7780 0x7fa60c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60b7fe640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c1656f0 0x7fa60c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 -- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0c7780 msgr2=0x7fa60c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa60c0c7780 0x7fa60c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 -- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c1656f0 msgr2=0x7fa60c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c1656f0 0x7fa60c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60affd640 1 -- 172.21.15.42:0/43398768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1f6370 con 0x7fa60c0b4e90 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.176+0000 7fa60b7fe640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c1656f0 0x7fa60c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.177+0000 7fa60affd640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c0b4e90 0x7fa60c15a360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c3e0 tx=0x7fa5fc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.177+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0074e0 con 0x7fa60c0b4e90 2024-05-09T01:45:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.177+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc0047e0 con 0x7fa60c0b4e90 2024-05-09T01:45:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.177+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc004bd0 con 0x7fa60c0b4e90 2024-05-09T01:45:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.177+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c1f65e0 con 0x7fa60c0b4e90 2024-05-09T01:45:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.177+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c1f70c0 con 0x7fa60c0b4e90 2024-05-09T01:45:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.178+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa60c0ce310 con 0x7fa60c0b4e90 2024-05-09T01:45:18.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5fc011070 con 0x7fa60c0b4e90 2024-05-09T01:45:18.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa6037fe640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5ec076300 0x7fa5ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa5fc097a80 con 0x7fa60c0b4e90 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa6037fe640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fa5ec07e6d0 0x7fa5ec080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 --> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5ec081270 con 0x7fa5ec07e6d0 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa5fc097f10 con 0x7fa60c0b4e90 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa60b7fe640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fa5ec07e6d0 0x7fa5ec080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.179+0000 7fa60a7fc640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5ec076300 0x7fa5ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.180+0000 7fa60b7fe640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fa5ec07e6d0 0x7fa5ec080ba0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.180+0000 7fa60a7fc640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5ec076300 0x7fa5ec078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa60c156620 tx=0x7fa5f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.180+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== osd.0 v2:172.21.15.42:6808/1460216605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5ec081270 con 0x7fa5ec07e6d0 2024-05-09T01:45:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 --> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa60c0cf930 con 0x7fa5ec07e6d0 2024-05-09T01:45:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6037fe640 1 -- 172.21.15.42:0/43398768 <== osd.0 v2:172.21.15.42:6808/1460216605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa60c0cf930 con 0x7fa5ec07e6d0 2024-05-09T01:45:18.192 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:18.192 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:18.192 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fa5ec07e6d0 msgr2=0x7fa5ec080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:6808/1460216605,v1:172.21.15.42:6809/1460216605] conn(0x7fa5ec07e6d0 0x7fa5ec080ba0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5ec076300 msgr2=0x7fa5ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa5ec076300 0x7fa5ec078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa60c156620 tx=0x7fa5f4008040 comp rx=0 tx=0).stop 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c0b4e90 msgr2=0x7fa60c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 --2- 172.21.15.42:0/43398768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c0b4e90 0x7fa60c15a360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c3e0 tx=0x7fa5fc00c8a0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa60b7fe640 1 -- 172.21.15.42:0/43398768 reap_dead start 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 shutdown_connections 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 >> 172.21.15.42:0/43398768 conn(0x7fa60c068e00 msgr2=0x7fa60c0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.194+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 shutdown_connections 2024-05-09T01:45:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.195+0000 7fa6115e0640 1 -- 172.21.15.42:0/43398768 wait complete. 2024-05-09T01:45:18.203 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T01:45:18.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.322+0000 7f04fe843640 1 Processor -- start 2024-05-09T01:45:18.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.322+0000 7f04fe843640 1 -- start start 2024-05-09T01:45:18.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.323+0000 7f04fe843640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 0x7f04f8157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.323+0000 7f04fe843640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f80c7bf0 con 0x7f04f80ce0d0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.323+0000 7f04fe843640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f80c7ed0 con 0x7f04f80ce4e0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.323+0000 7f04fe843640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f04f80ce8f0 con 0x7f04f80cdaa0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.323+0000 7f04effff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f04f80ce0d0 0x7f04f8160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57320/0 (socket says 172.21.15.42:57320) 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04effff640 1 -- 172.21.15.42:0/3169420599 learned_addr learned my addr 172.21.15.42:0/3169420599 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101756406 0 0) 0x7f04f80c7bf0 con 0x7f04f80ce0d0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f7fff640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 0x7f04f8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e4003520 con 0x7f04f80ce0d0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085114825 0 0) 0x7f04e4003520 con 0x7f04f80ce0d0 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 msgr2=0x7f04f8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 0x7f04f8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 >> v1:172.21.15.181:6789/0 conn(0x7f04f80ce4e0 legacy=0x7f04f80ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f80c81b0 con 0x7f04f80ce0d0 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f04e00016f0 con 0x7f04f80ce0d0 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 >> v1:172.21.15.42:6789/0 conn(0x7f04f80ce0d0 legacy=0x7f04f8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 0x7f04e4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04e4004d40 0x7f04e40051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04e40143e0 con 0x7f04e4004000 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4014590 con 0x7f04e4004d40 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f04e4014790 con 0x7f04f80cdaa0 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04effff640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04f7fff640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 0x7f04e4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.324+0000 7f04fcde0640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04e4004d40 0x7f04e40051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.325+0000 7f04effff640 1 -- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 msgr2=0x7f04e4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.325+0000 7f04effff640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f80cdaa0 0x7f04e4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.325+0000 7f04effff640 1 -- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04e4004d40 msgr2=0x7f04e40051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:18.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.325+0000 7f04effff640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04e4004d40 0x7f04e40051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.325+0000 7f04effff640 1 -- 172.21.15.42:0/3169420599 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e4003520 con 0x7f04e4004000 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.325+0000 7f04effff640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04e4004800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c210 tx=0x7f04e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5df9d3c802672b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0007ce0 con 0x7f04e4004000 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0005ad0 con 0x7f04e4004000 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04f77fe640 1 -- 172.21.15.42:0/3169420599 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0007070 con 0x7f04e4004000 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fe843640 1 -- 172.21.15.42:0/3169420599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 msgr2=0x7f04e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fe843640 1 --2- 172.21.15.42:0/3169420599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04e4004800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c210 tx=0x7f04e4005830 comp rx=0 tx=0).stop 2024-05-09T01:45:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fcde0640 1 -- 172.21.15.42:0/3169420599 reap_dead start 2024-05-09T01:45:18.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fe843640 1 -- 172.21.15.42:0/3169420599 shutdown_connections 2024-05-09T01:45:18.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fe843640 1 -- 172.21.15.42:0/3169420599 >> 172.21.15.42:0/3169420599 conn(0x7f04f8068610 msgr2=0x7f04f8068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fe843640 1 -- 172.21.15.42:0/3169420599 shutdown_connections 2024-05-09T01:45:18.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.326+0000 7f04fe843640 1 -- 172.21.15.42:0/3169420599 wait complete. 2024-05-09T01:45:18.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.328+0000 7f04fe843640 1 Processor -- start 2024-05-09T01:45:18.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.328+0000 7f04fe843640 1 -- start start 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04fe843640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04f81ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04fe843640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f8151240 0x7f04f814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04fe843640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f81f26e0 0x7f04f80d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04fe843640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80c8770 con 0x7f04e4004000 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04fe843640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80c79a0 con 0x7f04f81f26e0 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04fe843640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f04f8160470 con 0x7f04f8151240 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04f81ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04f81ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53334/0 (socket says 172.21.15.42:53334) 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.329+0000 7f04f7fff640 1 -- 172.21.15.42:0/1314591232 learned_addr learned my addr 172.21.15.42:0/1314591232 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:18.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04fcde0640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f81f26e0 0x7f04f80d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04effff640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f8151240 0x7f04f814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f7fff640 1 -- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f8151240 msgr2=0x7f04f814ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f7fff640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f8151240 0x7f04f814ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f7fff640 1 -- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f81f26e0 msgr2=0x7f04f80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f7fff640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f81f26e0 0x7f04f80d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f7fff640 1 -- 172.21.15.42:0/1314591232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f81ef6b0 con 0x7f04e4004000 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04fcde0640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f81f26e0 0x7f04f80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f7fff640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04f81ef170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f04e80119a0 tx=0x7f04e8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e800faf0 con 0x7f04e4004000 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e800fc90 con 0x7f04e4004000 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8014440 con 0x7f04e4004000 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f8152ca0 con 0x7f04e4004000 2024-05-09T01:45:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.330+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f81efc20 con 0x7f04e4004000 2024-05-09T01:45:18.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.331+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f8152e70 con 0x7f04e4004000 2024-05-09T01:45:18.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.332+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f04e8012040 con 0x7f04e4004000 2024-05-09T01:45:18.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.332+0000 7f04f57fa640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f04d80762d0 0x7f04d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.333+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f04e8097cd0 con 0x7f04e4004000 2024-05-09T01:45:18.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.333+0000 7f04effff640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f04d80762d0 0x7f04d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.333+0000 7f04effff640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f04d80762d0 0x7f04d80787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f04e0032000 tx=0x7f04e0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.337+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04e8019030 con 0x7f04e4004000 2024-05-09T01:45:18.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.532+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f04f8069f30 con 0x7f04d80762d0 2024-05-09T01:45:18.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.533+0000 7f04f57fa640 1 -- 172.21.15.42:0/1314591232 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f04f8069f30 con 0x7f04d80762d0 2024-05-09T01:45:18.530 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f04d80762d0 msgr2=0x7f04d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f04d80762d0 0x7f04d80787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f04e0032000 tx=0x7f04e0009030 comp rx=0 tx=0).stop 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 msgr2=0x7f04f81ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04f81ef170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f04e80119a0 tx=0x7f04e8011e60 comp rx=0 tx=0).stop 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 shutdown_connections 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f04d80762d0 0x7f04d80787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f81f26e0 0x7f04f80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f04f8151240 0x7f04f814ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 --2- 172.21.15.42:0/1314591232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04e4004000 0x7f04f81ef170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 >> 172.21.15.42:0/1314591232 conn(0x7f04f8068610 msgr2=0x7f04f80b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 shutdown_connections 2024-05-09T01:45:18.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.535+0000 7f04fe843640 1 -- 172.21.15.42:0/1314591232 wait complete. 2024-05-09T01:45:18.546 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T01:45:18.546 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:18.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.668+0000 7f5e83be0640 1 Processor -- start 2024-05-09T01:45:18.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.668+0000 7f5e83be0640 1 -- start start 2024-05-09T01:45:18.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.669+0000 7f5e83be0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e7c0cd8f0 0x7f5e7c168e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.669+0000 7f5e83be0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7c0cdd00 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.669+0000 7f5e83be0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7c15cf90 con 0x7f5e7c0c7780 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.669+0000 7f5e83be0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7c0ce890 con 0x7f5e7c0cd8f0 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8217d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e7c0cd8f0 0x7f5e7c168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8117b640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5e7c0b4e90 0x7f5e7c1656f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57328/0 (socket says 172.21.15.42:57328) 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8217d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e7c0cd8f0 0x7f5e7c168e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53342/0 (socket says 172.21.15.42:53342) 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8117b640 1 -- 172.21.15.42:0/2632798017 learned_addr learned my addr 172.21.15.42:0/2632798017 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8217d640 1 -- 172.21.15.42:0/2632798017 >> v1:172.21.15.181:6789/0 conn(0x7f5e7c0c7780 legacy=0x7f5e7c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8217d640 1 -- 172.21.15.42:0/2632798017 >> v1:172.21.15.42:6789/0 conn(0x7f5e7c0b4e90 legacy=0x7f5e7c1656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.670+0000 7f5e8217d640 1 -- 172.21.15.42:0/2632798017 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c0cce10 con 0x7f5e7c0cd8f0 2024-05-09T01:45:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.671+0000 7f5e8217d640 1 --2- 172.21.15.42:0/2632798017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0cd8f0 0x7f5e7c168e20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e740097a0 tx=0x7f5e7402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2d3da56ba24024 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.671+0000 7f5e8097a640 1 -- 172.21.15.42:0/2632798017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74037070 con 0x7f5e7c0cd8f0 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.671+0000 7f5e8097a640 1 -- 172.21.15.42:0/2632798017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e74032440 con 0x7f5e7c0cd8f0 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.671+0000 7f5e8097a640 1 -- 172.21.15.42:0/2632798017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74032810 con 0x7f5e7c0cd8f0 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.671+0000 7f5e83be0640 1 -- 172.21.15.42:0/2632798017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0cd8f0 msgr2=0x7f5e7c168e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.671+0000 7f5e83be0640 1 --2- 172.21.15.42:0/2632798017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0cd8f0 0x7f5e7c168e20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e740097a0 tx=0x7f5e7402a1a0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.672+0000 7f5e83be0640 1 -- 172.21.15.42:0/2632798017 shutdown_connections 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.672+0000 7f5e83be0640 1 --2- 172.21.15.42:0/2632798017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0cd8f0 0x7f5e7c168e20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.672+0000 7f5e83be0640 1 -- 172.21.15.42:0/2632798017 >> 172.21.15.42:0/2632798017 conn(0x7f5e7c068e00 msgr2=0x7f5e7c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.672+0000 7f5e83be0640 1 -- 172.21.15.42:0/2632798017 shutdown_connections 2024-05-09T01:45:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.672+0000 7f5e83be0640 1 -- 172.21.15.42:0/2632798017 wait complete. 2024-05-09T01:45:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.673+0000 7f5e83be0640 1 Processor -- start 2024-05-09T01:45:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.673+0000 7f5e83be0640 1 -- start start 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0b4e90 0x7f5e7c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e7c0c7780 0x7f5e7c1f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e7c0cd8f0 0x7f5e7c1e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c0cd460 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c0ccbc0 con 0x7f5e7c0c7780 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7c0ce530 con 0x7f5e7c0cd8f0 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0b4e90 0x7f5e7c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0b4e90 0x7f5e7c14a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53344/0 (socket says 172.21.15.42:53344) 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 -- 172.21.15.42:0/3980693720 learned_addr learned my addr 172.21.15.42:0/3980693720 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:18.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8217d640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e7c0cd8f0 0x7f5e7c1e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8117b640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e7c0c7780 0x7f5e7c1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 -- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e7c0cd8f0 msgr2=0x7f5e7c1e7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e7c0cd8f0 0x7f5e7c1e7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 -- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e7c0c7780 msgr2=0x7f5e7c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e7c0c7780 0x7f5e7c1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 -- 172.21.15.42:0/3980693720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c1519c0 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e8197c640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0b4e90 0x7f5e7c14a020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800c760 tx=0x7f5e7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78003b70 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e78003d30 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c1e8fd0 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.675+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800aa90 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.676+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c1e8490 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.676+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e7c14a560 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.677+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e7800ac30 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e727fc640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5e60076300 0x7f5e60078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5e78097ed0 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e727fc640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7f5e6007e6d0 0x7f5e60080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 --> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e60081270 con 0x7f5e6007e6d0 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5e78098360 con 0x7f5e7c0b4e90 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e8117b640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5e60076300 0x7f5e60078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e8217d640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7f5e6007e6d0 0x7f5e60080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.678+0000 7f5e8217d640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7f5e6007e6d0 0x7f5e60080ba0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.679+0000 7f5e8117b640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5e60076300 0x7f5e60078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0cfc70 tx=0x7f5e6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.679+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== osd.1 v2:172.21.15.42:6814/1456443554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e60081270 con 0x7f5e6007e6d0 2024-05-09T01:45:18.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.692+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 --> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5e7c151dc0 con 0x7f5e6007e6d0 2024-05-09T01:45:18.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e727fc640 1 -- 172.21.15.42:0/3980693720 <== osd.1 v2:172.21.15.42:6814/1456443554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5e7c151dc0 con 0x7f5e6007e6d0 2024-05-09T01:45:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:18.691 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:18.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7f5e6007e6d0 msgr2=0x7f5e60080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:6814/1456443554,v1:172.21.15.42:6816/1456443554] conn(0x7f5e6007e6d0 0x7f5e60080ba0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5e60076300 msgr2=0x7f5e60078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f5e60076300 0x7f5e60078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0cfc70 tx=0x7f5e6c009040 comp rx=0 tx=0).stop 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0b4e90 msgr2=0x7f5e7c14a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 --2- 172.21.15.42:0/3980693720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7c0b4e90 0x7f5e7c14a020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800c760 tx=0x7f5e7800cc20 comp rx=0 tx=0).stop 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e8217d640 1 -- 172.21.15.42:0/3980693720 reap_dead start 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 shutdown_connections 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 >> 172.21.15.42:0/3980693720 conn(0x7f5e7c068e00 msgr2=0x7f5e7c156630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 shutdown_connections 2024-05-09T01:45:18.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.693+0000 7f5e83be0640 1 -- 172.21.15.42:0/3980693720 wait complete. 2024-05-09T01:45:18.702 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T01:45:18.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.820+0000 7f6a9e653640 1 Processor -- start 2024-05-09T01:45:18.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.820+0000 7f6a9e653640 1 -- start start 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.821+0000 7f6a9e653640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6a98153b60 0x7f6a980c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.821+0000 7f6a9e653640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6a98072990 0x7f6a98072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.821+0000 7f6a9e653640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a980c8130 con 0x7f6a98159b30 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.821+0000 7f6a9e653640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6a980c6030 con 0x7f6a98153b60 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.821+0000 7f6a9e653640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6a980c5700 con 0x7f6a98072990 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6a98153b60 0x7f6a980c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6a98153b60 0x7f6a980c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53350/0 (socket says 172.21.15.42:53350) 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 -- 172.21.15.42:0/2917246410 learned_addr learned my addr 172.21.15.42:0/2917246410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a9cbf0640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6a98159b30 0x7f6a98159f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57336/0 (socket says 172.21.15.42:57336) 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a977fe640 1 --2- 172.21.15.42:0/2917246410 >> v2:172.21.15.181:3300/0 conn(0x7f6a98072990 0x7f6a98072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 -- 172.21.15.42:0/2917246410 >> v2:172.21.15.181:3300/0 conn(0x7f6a98072990 msgr2=0x7f6a98072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:18.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 --2- 172.21.15.42:0/2917246410 >> v2:172.21.15.181:3300/0 conn(0x7f6a98072990 0x7f6a98072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 -- 172.21.15.42:0/2917246410 >> v1:172.21.15.42:6789/0 conn(0x7f6a98159b30 legacy=0x7f6a98159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a97fff640 1 -- 172.21.15.42:0/2917246410 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a980c59e0 con 0x7f6a98153b60 2024-05-09T01:45:18.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.822+0000 7f6a96ffd640 1 -- 172.21.15.42:0/2917246410 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375352452 0 0) 0x7f6a980c8130 con 0x7f6a98159b30 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.823+0000 7f6a97fff640 1 --2- 172.21.15.42:0/2917246410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98153b60 0x7f6a980c7880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a98072920 tx=0x7f6a8802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4135febd7e9d97 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.823+0000 7f6a96ffd640 1 -- 172.21.15.42:0/2917246410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88037070 con 0x7f6a98153b60 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.823+0000 7f6a96ffd640 1 -- 172.21.15.42:0/2917246410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8802ae50 con 0x7f6a98153b60 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.823+0000 7f6a96ffd640 1 -- 172.21.15.42:0/2917246410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88032860 con 0x7f6a98153b60 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.823+0000 7f6a9e653640 1 -- 172.21.15.42:0/2917246410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98153b60 msgr2=0x7f6a980c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.823+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2917246410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98153b60 0x7f6a980c7880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a98072920 tx=0x7f6a8802a300 comp rx=0 tx=0).stop 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.824+0000 7f6a9e653640 1 -- 172.21.15.42:0/2917246410 shutdown_connections 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.824+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2917246410 >> v2:172.21.15.181:3300/0 conn(0x7f6a98072990 0x7f6a98072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.824+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2917246410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98153b60 0x7f6a980c7880 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.824+0000 7f6a9e653640 1 -- 172.21.15.42:0/2917246410 >> 172.21.15.42:0/2917246410 conn(0x7f6a9806cdc0 msgr2=0x7f6a980cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:18.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.824+0000 7f6a9e653640 1 -- 172.21.15.42:0/2917246410 shutdown_connections 2024-05-09T01:45:18.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.824+0000 7f6a9e653640 1 -- 172.21.15.42:0/2917246410 wait complete. 2024-05-09T01:45:18.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.825+0000 7f6a9e653640 1 Processor -- start 2024-05-09T01:45:18.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.826+0000 7f6a9e653640 1 -- start start 2024-05-09T01:45:18.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9e653640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 0x7f6a981f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9e653640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a98153b60 0x7f6a981e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9e653640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a98159b30 0x7f6a98157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9e653640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98074c20 con 0x7f6a98072990 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9e653640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6a980c7dc0 con 0x7f6a98153b60 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9e653640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6a980cec10 con 0x7f6a98159b30 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 0x7f6a981f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 0x7f6a981f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53356/0 (socket says 172.21.15.42:53356) 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 -- 172.21.15.42:0/2660078241 learned_addr learned my addr 172.21.15.42:0/2660078241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9cbf0640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a98159b30 0x7f6a98157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a977fe640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a98153b60 0x7f6a981e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 -- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a98159b30 msgr2=0x7f6a98157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a98159b30 0x7f6a98157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 -- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a98153b60 msgr2=0x7f6a981e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a98153b60 0x7f6a981e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 -- 172.21.15.42:0/2660078241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a981f38d0 con 0x7f6a98072990 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a9cbf0640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a98159b30 0x7f6a98157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a977fe640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a98153b60 0x7f6a981e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.827+0000 7f6a97fff640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 0x7f6a981f2dd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.828+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88041070 con 0x7f6a98072990 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.828+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8803c660 con 0x7f6a98072990 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.828+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a981f3bb0 con 0x7f6a98072990 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.828+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88037040 con 0x7f6a98072990 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.828+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a981f3310 con 0x7f6a98072990 2024-05-09T01:45:18.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.828+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a980734d0 con 0x7f6a98072990 2024-05-09T01:45:18.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.829+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a88044070 con 0x7f6a98072990 2024-05-09T01:45:18.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.830+0000 7f6a94ff9640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6a840762d0 0x7f6a840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:18.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.830+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6a880b7d40 con 0x7f6a98072990 2024-05-09T01:45:18.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.830+0000 7f6a977fe640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6a840762d0 0x7f6a840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:18.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.831+0000 7f6a977fe640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6a840762d0 0x7f6a840787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a98159440 tx=0x7f6a8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:18.834+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a88081580 con 0x7f6a98072990 2024-05-09T01:45:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.025+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6a981f3680 con 0x7f6a840762d0 2024-05-09T01:45:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.025+0000 7f6a94ff9640 1 -- 172.21.15.42:0/2660078241 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a981f3680 con 0x7f6a840762d0 2024-05-09T01:45:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6a840762d0 msgr2=0x7f6a840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6a840762d0 0x7f6a840787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a98159440 tx=0x7f6a8c008040 comp rx=0 tx=0).stop 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 msgr2=0x7f6a981f2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 0x7f6a981f2dd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a880046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 shutdown_connections 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6a840762d0 0x7f6a840787e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a98159b30 0x7f6a98157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a98153b60 0x7f6a981e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 --2- 172.21.15.42:0/2660078241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a98072990 0x7f6a981f2dd0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 >> 172.21.15.42:0/2660078241 conn(0x7f6a9806cdc0 msgr2=0x7f6a98159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 shutdown_connections 2024-05-09T01:45:19.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.028+0000 7f6a9e653640 1 -- 172.21.15.42:0/2660078241 wait complete. 2024-05-09T01:45:19.037 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T01:45:19.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:19.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.159+0000 7f7ac27dc640 1 Processor -- start 2024-05-09T01:45:19.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.159+0000 7f7ac27dc640 1 -- start start 2024-05-09T01:45:19.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7ac27dc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc154cf0 0x7f7abc15b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7ac27dc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7ac27dc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7abc0c5850 0x7f7abc0d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7ac27dc640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc155100 con 0x7f7abc154cf0 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7ac27dc640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc0cb390 con 0x7f7abc0c5850 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7ac27dc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc15eb80 con 0x7f7abc0c5440 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7abbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc154cf0 0x7f7abc15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7abbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc154cf0 0x7f7abc15b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53366/0 (socket says 172.21.15.42:53366) 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.160+0000 7f7abbfff640 1 -- 172.21.15.42:0/4005385255 learned_addr learned my addr 172.21.15.42:0/4005385255 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abb7fe640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7ac0d79640 1 --2- 172.21.15.42:0/4005385255 >> v2:172.21.15.181:3300/0 conn(0x7f7abc0c5850 0x7f7abc0d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abbfff640 1 -- 172.21.15.42:0/4005385255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 msgr2=0x7f7abc0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abbfff640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abbfff640 1 -- 172.21.15.42:0/4005385255 >> v2:172.21.15.181:3300/0 conn(0x7f7abc0c5850 msgr2=0x7f7abc0d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:19.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abbfff640 1 --2- 172.21.15.42:0/4005385255 >> v2:172.21.15.181:3300/0 conn(0x7f7abc0c5850 0x7f7abc0d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abbfff640 1 -- 172.21.15.42:0/4005385255 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc0cb5c0 con 0x7f7abc154cf0 2024-05-09T01:45:19.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abb7fe640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:19.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7ac0d79640 1 --2- 172.21.15.42:0/4005385255 >> v2:172.21.15.181:3300/0 conn(0x7f7abc0c5850 0x7f7abc0d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:19.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abbfff640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc154cf0 0x7f7abc15b610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7abc069370 tx=0x7f7aac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b787420543ff9ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.161+0000 7f7abaffd640 1 -- 172.21.15.42:0/4005385255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac037070 con 0x7f7abc154cf0 2024-05-09T01:45:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7abaffd640 1 -- 172.21.15.42:0/4005385255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac032440 con 0x7f7abc154cf0 2024-05-09T01:45:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7abaffd640 1 -- 172.21.15.42:0/4005385255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac032810 con 0x7f7abc154cf0 2024-05-09T01:45:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 -- 172.21.15.42:0/4005385255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc154cf0 msgr2=0x7f7abc15b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc154cf0 0x7f7abc15b610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7abc069370 tx=0x7f7aac02a270 comp rx=0 tx=0).stop 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 -- 172.21.15.42:0/4005385255 shutdown_connections 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/4005385255 >> v2:172.21.15.181:3300/0 conn(0x7f7abc0c5850 0x7f7abc0d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/4005385255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc154cf0 0x7f7abc15b610 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 -- 172.21.15.42:0/4005385255 >> 172.21.15.42:0/4005385255 conn(0x7f7abc068610 msgr2=0x7f7abc068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 -- 172.21.15.42:0/4005385255 shutdown_connections 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.162+0000 7f7ac27dc640 1 -- 172.21.15.42:0/4005385255 wait complete. 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.164+0000 7f7ac27dc640 1 Processor -- start 2024-05-09T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.164+0000 7f7ac27dc640 1 -- start start 2024-05-09T01:45:19.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.165+0000 7f7ac27dc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.165+0000 7f7ac27dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc0c5850 0x7f7abc14acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.165+0000 7f7ac27dc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc154cf0 0x7f7abc0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.165+0000 7f7ac27dc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc15e530 con 0x7f7abc0c5850 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.165+0000 7f7ac27dc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc15bb50 con 0x7f7abc154cf0 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.165+0000 7f7ac27dc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc15e810 con 0x7f7abc0c5440 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc0c5850 0x7f7abc14acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc0c5850 0x7f7abc14acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53374/0 (socket says 172.21.15.42:53374) 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 -- 172.21.15.42:0/1734848489 learned_addr learned my addr 172.21.15.42:0/1734848489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7ac0d79640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc154cf0 0x7f7abc0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abbfff640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 -- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 msgr2=0x7f7abc1f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0c5440 0x7f7abc1f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 -- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc154cf0 msgr2=0x7f7abc0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc154cf0 0x7f7abc0b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 -- 172.21.15.42:0/1734848489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc1f3650 con 0x7f7abc0c5850 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7abb7fe640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc0c5850 0x7f7abc14acc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c820 tx=0x7f7ab000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0015070 con 0x7f7abc0c5850 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab0007a30 con 0x7f7abc0c5850 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0007e20 con 0x7f7abc0c5850 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc156c50 con 0x7f7abc0c5850 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.166+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc1571d0 con 0x7f7abc0c5850 2024-05-09T01:45:19.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.167+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7abc153350 con 0x7f7abc0c5850 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.168+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ab0018070 con 0x7f7abc0c5850 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7ab8ff9640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f7aa80762d0 0x7f7aa80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7ab0097b30 con 0x7f7abc0c5850 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7abbfff640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f7aa80762d0 0x7f7aa80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7ab8ff9640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f7aa807e6a0 0x7f7aa8080b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 --> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ab0008e50 con 0x7f7aa807e6a0 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7ab0097fc0 con 0x7f7abc0c5850 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.169+0000 7f7ac0d79640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f7aa807e6a0 0x7f7aa8080b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.170+0000 7f7ac0d79640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f7aa807e6a0 0x7f7aa8080b70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.170+0000 7f7abbfff640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f7aa80762d0 0x7f7aa80787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7aac034000 tx=0x7f7aac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.170+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== osd.2 v2:172.21.15.42:6824/1807965313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ab0008e50 con 0x7f7aa807e6a0 2024-05-09T01:45:19.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 --> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7abc0b0560 con 0x7f7aa807e6a0 2024-05-09T01:45:19.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ab8ff9640 1 -- 172.21.15.42:0/1734848489 <== osd.2 v2:172.21.15.42:6824/1807965313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7abc0b0560 con 0x7f7aa807e6a0 2024-05-09T01:45:19.182 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:19.182 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:19.183 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f7aa807e6a0 msgr2=0x7f7aa8080b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:6824/1807965313,v1:172.21.15.42:6825/1807965313] conn(0x7f7aa807e6a0 0x7f7aa8080b70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f7aa80762d0 msgr2=0x7f7aa80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f7aa80762d0 0x7f7aa80787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7aac034000 tx=0x7f7aac02e000 comp rx=0 tx=0).stop 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc0c5850 msgr2=0x7f7abc14acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 --2- 172.21.15.42:0/1734848489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc0c5850 0x7f7abc14acc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c820 tx=0x7f7ab000cce0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac0d79640 1 -- 172.21.15.42:0/1734848489 reap_dead start 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 shutdown_connections 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 >> 172.21.15.42:0/1734848489 conn(0x7f7abc068610 msgr2=0x7f7abc0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 shutdown_connections 2024-05-09T01:45:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.184+0000 7f7ac27dc640 1 -- 172.21.15.42:0/1734848489 wait complete. 2024-05-09T01:45:19.193 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T01:45:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.311+0000 7f4d25453640 1 Processor -- start 2024-05-09T01:45:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.311+0000 7f4d25453640 1 -- start start 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d25453640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d2015b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d25453640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2006c670 0x7f4d2015b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d25453640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d2015ab40 con 0x7f4d2006d360 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d25453640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f4d200c98e0 con 0x7f4d2006c670 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d25453640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d200c9bc0 con 0x7f4d20155000 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d1f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2006c670 0x7f4d2015b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d1effd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4d2006d360 0x7f4d20074490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57342/0 (socket says 172.21.15.42:57342) 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d1f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2006c670 0x7f4d2015b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53376/0 (socket says 172.21.15.42:53376) 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d1effd640 1 -- 172.21.15.42:0/1421384634 learned_addr learned my addr 172.21.15.42:0/1421384634 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:19.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.312+0000 7f4d1e7fc640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d2015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1421384634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 msgr2=0x7f4d2015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1f7fe640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d2015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1421384634 >> v1:172.21.15.42:6789/0 conn(0x7f4d2006d360 legacy=0x7f4d20074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1dffb640 1 -- 172.21.15.42:0/1421384634 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093340101 0 0) 0x7f4d2015ab40 con 0x7f4d2006d360 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1421384634 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200c9ea0 con 0x7f4d2006c670 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1e7fc640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d2015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1f7fe640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2006c670 0x7f4d2015b580 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009d90 tx=0x7f4d1802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc0ed36f328693 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1dffb640 1 -- 172.21.15.42:0/1421384634 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18007740 con 0x7f4d2006c670 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1dffb640 1 -- 172.21.15.42:0/1421384634 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180078e0 con 0x7f4d2006c670 2024-05-09T01:45:19.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.313+0000 7f4d1dffb640 1 -- 172.21.15.42:0/1421384634 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18007cb0 con 0x7f4d2006c670 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 -- 172.21.15.42:0/1421384634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2006c670 msgr2=0x7f4d2015b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2006c670 0x7f4d2015b580 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009d90 tx=0x7f4d1802a660 comp rx=0 tx=0).stop 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 -- 172.21.15.42:0/1421384634 shutdown_connections 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2006c670 0x7f4d2015b580 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 --2- 172.21.15.42:0/1421384634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d2015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 -- 172.21.15.42:0/1421384634 >> 172.21.15.42:0/1421384634 conn(0x7f4d2006dba0 msgr2=0x7f4d2006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 -- 172.21.15.42:0/1421384634 shutdown_connections 2024-05-09T01:45:19.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.314+0000 7f4d25453640 1 -- 172.21.15.42:0/1421384634 wait complete. 2024-05-09T01:45:19.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.316+0000 7f4d25453640 1 Processor -- start 2024-05-09T01:45:19.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.316+0000 7f4d25453640 1 -- start start 2024-05-09T01:45:19.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.317+0000 7f4d25453640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d2006c670 0x7f4d20159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.317+0000 7f4d25453640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d200c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.317+0000 7f4d25453640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 0x7f4d201f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.317+0000 7f4d25453640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d20073ef0 con 0x7f4d201f3fa0 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.317+0000 7f4d25453640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d200ca460 con 0x7f4d2006c670 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.317+0000 7f4d25453640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d20074070 con 0x7f4d20155000 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 0x7f4d201f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 0x7f4d201f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53382/0 (socket says 172.21.15.42:53382) 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1628146673 learned_addr learned my addr 172.21.15.42:0/1628146673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1effd640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d2006c670 0x7f4d20159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1e7fc640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d200c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 msgr2=0x7f4d200c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d200c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d2006c670 msgr2=0x7f4d20159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d2006c670 0x7f4d20159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 -- 172.21.15.42:0/1628146673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200c4840 con 0x7f4d201f3fa0 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d1f7fe640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 0x7f4d201f43b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009eb0 tx=0x7f4d18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1803f070 con 0x7f4d201f3fa0 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18031bc0 con 0x7f4d201f3fa0 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d201f4cb0 con 0x7f4d201f3fa0 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18044460 con 0x7f4d201f3fa0 2024-05-09T01:45:19.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.318+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d200c5390 con 0x7f4d201f3fa0 2024-05-09T01:45:19.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.319+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2006d140 con 0x7f4d201f3fa0 2024-05-09T01:45:19.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.320+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d18007790 con 0x7f4d201f3fa0 2024-05-09T01:45:19.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.321+0000 7f4d077fe640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d0c076300 0x7f4d0c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.321+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4d180b8d00 con 0x7f4d201f3fa0 2024-05-09T01:45:19.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.321+0000 7f4d1effd640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d0c076300 0x7f4d0c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.322+0000 7f4d1effd640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d0c076300 0x7f4d0c078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d10007fd0 tx=0x7f4d10007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.326+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4d18082020 con 0x7f4d201f3fa0 2024-05-09T01:45:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.521+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4d201f49d0 con 0x7f4d0c076300 2024-05-09T01:45:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.522+0000 7f4d077fe640 1 -- 172.21.15.42:0/1628146673 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4d201f49d0 con 0x7f4d0c076300 2024-05-09T01:45:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T01:45:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d0c076300 msgr2=0x7f4d0c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d0c076300 0x7f4d0c078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d10007fd0 tx=0x7f4d10007de0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 msgr2=0x7f4d201f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 0x7f4d201f43b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009eb0 tx=0x7f4d18004a40 comp rx=0 tx=0).stop 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 shutdown_connections 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d0c076300 0x7f4d0c078810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d201f3fa0 0x7f4d201f43b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d20155000 0x7f4d200c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 --2- 172.21.15.42:0/1628146673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d2006c670 0x7f4d20159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 >> 172.21.15.42:0/1628146673 conn(0x7f4d2006dba0 msgr2=0x7f4d20153390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 shutdown_connections 2024-05-09T01:45:19.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.524+0000 7f4d25453640 1 -- 172.21.15.42:0/1628146673 wait complete. 2024-05-09T01:45:19.534 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T01:45:19.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.657+0000 7fceafb72640 1 Processor -- start 2024-05-09T01:45:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.657+0000 7fceafb72640 1 -- start start 2024-05-09T01:45:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fceafb72640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcea81516e0 0x7fcea80ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fceafb72640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcea815b010 0x7fcea815b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fceafb72640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea8074270 con 0x7fcea8073930 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fceafb72640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fcea8074550 con 0x7fcea81516e0 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fceafb72640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcea8074830 con 0x7fcea815b010 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fcead10d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcea81516e0 0x7fcea80ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fcead90e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fcea8073930 0x7fcea806c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57350/0 (socket says 172.21.15.42:57350) 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.658+0000 7fcead90e640 1 -- 172.21.15.42:0/4001782909 learned_addr learned my addr 172.21.15.42:0/4001782909 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fceae10f640 1 --2- 172.21.15.42:0/4001782909 >> v2:172.21.15.181:3300/0 conn(0x7fcea815b010 0x7fcea815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fcead10d640 1 -- 172.21.15.42:0/4001782909 >> v2:172.21.15.181:3300/0 conn(0x7fcea815b010 msgr2=0x7fcea815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fcead10d640 1 --2- 172.21.15.42:0/4001782909 >> v2:172.21.15.181:3300/0 conn(0x7fcea815b010 0x7fcea815b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fcead10d640 1 -- 172.21.15.42:0/4001782909 >> v1:172.21.15.42:6789/0 conn(0x7fcea8073930 legacy=0x7fcea806c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fcead10d640 1 -- 172.21.15.42:0/4001782909 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea8074b10 con 0x7fcea81516e0 2024-05-09T01:45:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fceac90c640 1 -- 172.21.15.42:0/4001782909 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191540465 0 0) 0x7fcea8074270 con 0x7fcea8073930 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.659+0000 7fcead10d640 1 --2- 172.21.15.42:0/4001782909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea81516e0 0x7fcea80ca350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcea8073830 tx=0x7fce9c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2268a444fe4f718a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceac90c640 1 -- 172.21.15.42:0/4001782909 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c037070 con 0x7fcea81516e0 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceac90c640 1 -- 172.21.15.42:0/4001782909 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c032440 con 0x7fcea81516e0 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceac90c640 1 -- 172.21.15.42:0/4001782909 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c032810 con 0x7fcea81516e0 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 -- 172.21.15.42:0/4001782909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea81516e0 msgr2=0x7fcea80ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 --2- 172.21.15.42:0/4001782909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea81516e0 0x7fcea80ca350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcea8073830 tx=0x7fce9c02a1a0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 -- 172.21.15.42:0/4001782909 shutdown_connections 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 --2- 172.21.15.42:0/4001782909 >> v2:172.21.15.181:3300/0 conn(0x7fcea815b010 0x7fcea815b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 --2- 172.21.15.42:0/4001782909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea81516e0 0x7fcea80ca350 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 -- 172.21.15.42:0/4001782909 >> 172.21.15.42:0/4001782909 conn(0x7fcea806dba0 msgr2=0x7fcea806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 -- 172.21.15.42:0/4001782909 shutdown_connections 2024-05-09T01:45:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.660+0000 7fceafb72640 1 -- 172.21.15.42:0/4001782909 wait complete. 2024-05-09T01:45:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.662+0000 7fceafb72640 1 Processor -- start 2024-05-09T01:45:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.662+0000 7fceafb72640 1 -- start start 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceafb72640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea8073930 0x7fcea8157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceafb72640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcea81516e0 0x7fcea8152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceafb72640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcea815b010 0x7fcea8071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceafb72640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcea80ca970 con 0x7fcea8073930 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceafb72640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcea80cb770 con 0x7fcea81516e0 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceafb72640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcea8155170 con 0x7fcea815b010 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea8073930 0x7fcea8157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea8073930 0x7fcea8157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53400/0 (socket says 172.21.15.42:53400) 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 -- 172.21.15.42:0/2191045530 learned_addr learned my addr 172.21.15.42:0/2191045530 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead10d640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcea81516e0 0x7fcea8152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fceae10f640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcea815b010 0x7fcea8071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 -- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcea815b010 msgr2=0x7fcea8071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcea815b010 0x7fcea8071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 -- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcea81516e0 msgr2=0x7fcea8152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcea81516e0 0x7fcea8152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 -- 172.21.15.42:0/2191045530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea8151b90 con 0x7fcea8073930 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.664+0000 7fcead90e640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea8073930 0x7fcea8157420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c3e0 tx=0x7fcea000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.665+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea00074e0 con 0x7fcea8073930 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.665+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea00047e0 con 0x7fcea8073930 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.665+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea81581b0 con 0x7fcea8073930 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.665+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0004bd0 con 0x7fcea8073930 2024-05-09T01:45:19.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.665+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea8158490 con 0x7fcea8073930 2024-05-09T01:45:19.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.666+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcea8157f60 con 0x7fcea8073930 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.667+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcea0011070 con 0x7fcea8073930 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fcea67fc640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce94076300 0x7fce94078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fcea0097050 con 0x7fcea8073930 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fcead10d640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce94076300 0x7fce94078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fcea67fc640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7fce9407e6d0 0x7fce94080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 --> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce94081270 con 0x7fce9407e6d0 2024-05-09T01:45:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcea009e050 con 0x7fcea8073930 2024-05-09T01:45:19.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fceae10f640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7fce9407e6d0 0x7fce94080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.668+0000 7fceae10f640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7fce9407e6d0 0x7fce94080ba0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.669+0000 7fcead10d640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce94076300 0x7fce94078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce9c034000 tx=0x7fce9c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.669+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== osd.3 v2:172.21.15.42:6800/1948174353 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce94081270 con 0x7fce9407e6d0 2024-05-09T01:45:19.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 --> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcea80cb190 con 0x7fce9407e6d0 2024-05-09T01:45:19.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fcea67fc640 1 -- 172.21.15.42:0/2191045530 <== osd.3 v2:172.21.15.42:6800/1948174353 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcea80cb190 con 0x7fce9407e6d0 2024-05-09T01:45:19.681 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:19.681 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:19.681 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7fce9407e6d0 msgr2=0x7fce94080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:6800/1948174353,v1:172.21.15.42:6801/1948174353] conn(0x7fce9407e6d0 0x7fce94080ba0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce94076300 msgr2=0x7fce94078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce94076300 0x7fce94078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce9c034000 tx=0x7fce9c02e000 comp rx=0 tx=0).stop 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea8073930 msgr2=0x7fcea8157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 --2- 172.21.15.42:0/2191045530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcea8073930 0x7fcea8157420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c3e0 tx=0x7fcea000c8a0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceae10f640 1 -- 172.21.15.42:0/2191045530 reap_dead start 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 shutdown_connections 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 >> 172.21.15.42:0/2191045530 conn(0x7fcea806dba0 msgr2=0x7fcea814f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 shutdown_connections 2024-05-09T01:45:19.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.683+0000 7fceafb72640 1 -- 172.21.15.42:0/2191045530 wait complete. 2024-05-09T01:45:19.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T01:45:19.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.811+0000 7fe9a6914640 1 Processor -- start 2024-05-09T01:45:19.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.811+0000 7fe9a6914640 1 -- start start 2024-05-09T01:45:19.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe9a6914640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe9a00c9500 0x7fe9a00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe9a6914640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a01570f0 0x7fe9a00ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe9a6914640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a0160420 con 0x7fe9a00b7ba0 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe9a6914640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a01612f0 con 0x7fe9a00c9500 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe9a6914640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a00cc350 con 0x7fe9a01570f0 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe99f7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe9a00b7ba0 0x7fe9a00c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57364/0 (socket says 172.21.15.42:57364) 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe99f7fe640 1 -- 172.21.15.42:0/1887882816 learned_addr learned my addr 172.21.15.42:0/1887882816 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe99ffff640 1 --2- 172.21.15.42:0/1887882816 >> v2:172.21.15.181:3300/0 conn(0x7fe9a00c9500 0x7fe9a00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe9a4eb1640 1 --2- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a01570f0 0x7fe9a00ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe99effd640 1 -- 172.21.15.42:0/1887882816 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291081723 0 0) 0x7fe9a0160420 con 0x7fe9a00b7ba0 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.812+0000 7fe99effd640 1 -- 172.21.15.42:0/1887882816 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe988003520 con 0x7fe9a00b7ba0 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.813+0000 7fe99ffff640 1 -- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a01570f0 msgr2=0x7fe9a00ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.813+0000 7fe99ffff640 1 --2- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a01570f0 0x7fe9a00ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.813+0000 7fe99ffff640 1 -- 172.21.15.42:0/1887882816 >> v1:172.21.15.42:6789/0 conn(0x7fe9a00b7ba0 legacy=0x7fe9a00c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.813+0000 7fe99ffff640 1 -- 172.21.15.42:0/1887882816 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a01606e0 con 0x7fe9a00c9500 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.813+0000 7fe99ffff640 1 --2- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00c9500 0x7fe9a00ce4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9900097a0 tx=0x7fe99002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f642403d162e44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe99effd640 1 -- 172.21.15.42:0/1887882816 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990037070 con 0x7fe9a00c9500 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe99effd640 1 -- 172.21.15.42:0/1887882816 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe990032440 con 0x7fe9a00c9500 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe99effd640 1 -- 172.21.15.42:0/1887882816 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990032810 con 0x7fe9a00c9500 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 -- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00c9500 msgr2=0x7fe9a00ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 --2- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00c9500 0x7fe9a00ce4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9900097a0 tx=0x7fe99002a180 comp rx=0 tx=0).stop 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 -- 172.21.15.42:0/1887882816 shutdown_connections 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 --2- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a01570f0 0x7fe9a00ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 --2- 172.21.15.42:0/1887882816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00c9500 0x7fe9a00ce4b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 -- 172.21.15.42:0/1887882816 >> 172.21.15.42:0/1887882816 conn(0x7fe9a00d2100 msgr2=0x7fe9a00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 -- 172.21.15.42:0/1887882816 shutdown_connections 2024-05-09T01:45:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.814+0000 7fe9a6914640 1 -- 172.21.15.42:0/1887882816 wait complete. 2024-05-09T01:45:19.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.816+0000 7fe9a6914640 1 Processor -- start 2024-05-09T01:45:19.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.816+0000 7fe9a6914640 1 -- start start 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a6914640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00b7ba0 0x7fe9a01f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a6914640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a00c9500 0x7fe9a01f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a6914640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 0x7fe9a00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a6914640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0160f80 con 0x7fe9a01570f0 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a6914640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0160ca0 con 0x7fe9a00b7ba0 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a6914640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a0157500 con 0x7fe9a00c9500 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 0x7fe9a00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 0x7fe9a00d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53416/0 (socket says 172.21.15.42:53416) 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 -- 172.21.15.42:0/2444884553 learned_addr learned my addr 172.21.15.42:0/2444884553 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe99ffff640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00b7ba0 0x7fe9a01f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe99f7fe640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a00c9500 0x7fe9a01f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 -- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a00c9500 msgr2=0x7fe9a01f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a00c9500 0x7fe9a01f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 -- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00b7ba0 msgr2=0x7fe9a01f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00b7ba0 0x7fe9a01f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 -- 172.21.15.42:0/2444884553 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a01f7580 con 0x7fe9a01570f0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe99ffff640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00b7ba0 0x7fe9a01f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe9a4eb1640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 0x7fe9a00d1060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe998009cb0 tx=0x7fe99800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998018020 con 0x7fe9a01570f0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.818+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe998014480 con 0x7fe9a01570f0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.819+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998014870 con 0x7fe9a01570f0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.819+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a01e93c0 con 0x7fe9a01570f0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.819+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01e8e00 con 0x7fe9a01570f0 2024-05-09T01:45:19.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.819+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a00cbf50 con 0x7fe9a01570f0 2024-05-09T01:45:19.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.820+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe998005d10 con 0x7fe9a01570f0 2024-05-09T01:45:19.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.821+0000 7fe99cff9640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe98c0762d0 0x7fe98c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:19.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.821+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe9980981d0 con 0x7fe9a01570f0 2024-05-09T01:45:19.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.821+0000 7fe99ffff640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe98c0762d0 0x7fe98c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:19.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.822+0000 7fe99ffff640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe98c0762d0 0x7fe98c0787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe990034000 tx=0x7fe99002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:19.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:19.825+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe998022030 con 0x7fe9a01570f0 2024-05-09T01:45:20.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.021+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe9a00c89f0 con 0x7fe98c0762d0 2024-05-09T01:45:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.021+0000 7fe99cff9640 1 -- 172.21.15.42:0/2444884553 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9a00c89f0 con 0x7fe98c0762d0 2024-05-09T01:45:20.019 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe98c0762d0 msgr2=0x7fe98c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe98c0762d0 0x7fe98c0787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe990034000 tx=0x7fe99002e000 comp rx=0 tx=0).stop 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 msgr2=0x7fe9a00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 0x7fe9a00d1060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe998009cb0 tx=0x7fe99800c490 comp rx=0 tx=0).stop 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 shutdown_connections 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe98c0762d0 0x7fe98c0787e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9a01570f0 0x7fe9a00d1060 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9a00c9500 0x7fe9a01f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 --2- 172.21.15.42:0/2444884553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9a00b7ba0 0x7fe9a01f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 >> 172.21.15.42:0/2444884553 conn(0x7fe9a00d2100 msgr2=0x7fe9a006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 shutdown_connections 2024-05-09T01:45:20.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.024+0000 7fe9a6914640 1 -- 172.21.15.42:0/2444884553 wait complete. 2024-05-09T01:45:20.033 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T01:45:20.033 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:20.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.155+0000 7f606735e640 1 Processor -- start 2024-05-09T01:45:20.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.155+0000 7f606735e640 1 -- start start 2024-05-09T01:45:20.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.156+0000 7f606735e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f60600c7780 0x7f60600cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f606735e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60600b4e90 0x7f606006d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f606735e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f6060160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f606735e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f60600ce890 con 0x7f60600b4e90 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f606735e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f60600ccbc0 con 0x7f60600c7780 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f606735e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f60600cd460 con 0x7f606006dba0 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60600b4e90 0x7f606006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60600b4e90 0x7f606006d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53432/0 (socket says 172.21.15.42:53432) 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 -- 172.21.15.42:0/1153011803 learned_addr learned my addr 172.21.15.42:0/1153011803 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60658fb640 1 --2- 172.21.15.42:0/1153011803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f6060160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60650fa640 1 --2- 172.21.15.42:0/1153011803 >> v2:172.21.15.181:3300/0 conn(0x7f60600c7780 0x7f60600cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 -- 172.21.15.42:0/1153011803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 msgr2=0x7f6060160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 --2- 172.21.15.42:0/1153011803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f6060160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 -- 172.21.15.42:0/1153011803 >> v2:172.21.15.181:3300/0 conn(0x7f60600c7780 msgr2=0x7f60600cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 --2- 172.21.15.42:0/1153011803 >> v2:172.21.15.181:3300/0 conn(0x7f60600c7780 0x7f60600cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.157+0000 7f60648f9640 1 -- 172.21.15.42:0/1153011803 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606015cf90 con 0x7f60600b4e90 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.158+0000 7f60648f9640 1 --2- 172.21.15.42:0/1153011803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606006d660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60600d29d0 tx=0x7f605402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d6cf7950448652 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.158+0000 7f605ffff640 1 -- 172.21.15.42:0/1153011803 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054037070 con 0x7f60600b4e90 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.158+0000 7f605ffff640 1 -- 172.21.15.42:0/1153011803 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6054032440 con 0x7f60600b4e90 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.158+0000 7f605ffff640 1 -- 172.21.15.42:0/1153011803 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054032810 con 0x7f60600b4e90 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 -- 172.21.15.42:0/1153011803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 msgr2=0x7f606006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 --2- 172.21.15.42:0/1153011803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606006d660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60600d29d0 tx=0x7f605402a140 comp rx=0 tx=0).stop 2024-05-09T01:45:20.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 -- 172.21.15.42:0/1153011803 shutdown_connections 2024-05-09T01:45:20.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 --2- 172.21.15.42:0/1153011803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f6060160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 --2- 172.21.15.42:0/1153011803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606006d660 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 --2- 172.21.15.42:0/1153011803 >> v2:172.21.15.181:3300/0 conn(0x7f60600c7780 0x7f60600cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 -- 172.21.15.42:0/1153011803 >> 172.21.15.42:0/1153011803 conn(0x7f6060068e00 msgr2=0x7f60600d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 -- 172.21.15.42:0/1153011803 shutdown_connections 2024-05-09T01:45:20.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.159+0000 7f606735e640 1 -- 172.21.15.42:0/1153011803 wait complete. 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.160+0000 7f606735e640 1 Processor -- start 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.161+0000 7f606735e640 1 -- start start 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f606735e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f606015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f606735e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f606735e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60600c7780 0x7f6060158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f606735e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f60600ce530 con 0x7f60600b4e90 2024-05-09T01:45:20.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f606735e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60600cd0f0 con 0x7f60600c7780 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f606735e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6060157350 con 0x7f606006dba0 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606014c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53446/0 (socket says 172.21.15.42:53446) 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 -- 172.21.15.42:0/2983457236 learned_addr learned my addr 172.21.15.42:0/2983457236 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60650fa640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f606015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60658fb640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60600c7780 0x7f6060158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 -- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 msgr2=0x7f606015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f606015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 -- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60600c7780 msgr2=0x7f6060158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60600c7780 0x7f6060158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 -- 172.21.15.42:0/2983457236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606015b880 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60650fa640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f606006dba0 0x7f606015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.162+0000 7f60648f9640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606014c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6054000c00 tx=0x7f60540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.163+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054041020 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.163+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60540306c0 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.163+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60601577a0 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.163+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054037040 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.163+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606015ab40 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.164+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60600ce310 con 0x7f60600b4e90 2024-05-09T01:45:20.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.164+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6054044020 con 0x7f60600b4e90 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.165+0000 7f605dffb640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f604c076300 0x7f604c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.165+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f60540b7f20 con 0x7f60600b4e90 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.165+0000 7f605dffb640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f604c07e6d0 0x7f604c080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.165+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 --> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6054032440 con 0x7f604c07e6d0 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.165+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f60540ba540 con 0x7f60600b4e90 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.165+0000 7f60650fa640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f604c076300 0x7f604c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.166+0000 7f60658fb640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f604c07e6d0 0x7f604c080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.166+0000 7f60650fa640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f604c076300 0x7f604c078810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6058006fd0 tx=0x7f6058008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.166+0000 7f60658fb640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f604c07e6d0 0x7f604c080ba0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.168+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== osd.4 v2:172.21.15.181:6800/1664109051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6054032440 con 0x7f604c07e6d0 2024-05-09T01:45:20.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.181+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 --> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f60600cea30 con 0x7f604c07e6d0 2024-05-09T01:45:20.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f605dffb640 1 -- 172.21.15.42:0/2983457236 <== osd.4 v2:172.21.15.181:6800/1664109051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f60600cea30 con 0x7f604c07e6d0 2024-05-09T01:45:20.180 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:20.180 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:20.180 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f604c07e6d0 msgr2=0x7f604c080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6800/1664109051,v1:172.21.15.181:6801/1664109051] conn(0x7f604c07e6d0 0x7f604c080ba0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f604c076300 msgr2=0x7f604c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f604c076300 0x7f604c078810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6058006fd0 tx=0x7f6058008040 comp rx=0 tx=0).stop 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 msgr2=0x7f606014c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 --2- 172.21.15.42:0/2983457236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60600b4e90 0x7f606014c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6054000c00 tx=0x7f60540046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f60658fb640 1 -- 172.21.15.42:0/2983457236 reap_dead start 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 shutdown_connections 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 >> 172.21.15.42:0/2983457236 conn(0x7f6060068e00 msgr2=0x7f60601e61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 shutdown_connections 2024-05-09T01:45:20.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.182+0000 7f606735e640 1 -- 172.21.15.42:0/2983457236 wait complete. 2024-05-09T01:45:20.191 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T01:45:20.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.310+0000 7f55f5d00640 1 Processor -- start 2024-05-09T01:45:20.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.310+0000 7f55f5d00640 1 -- start start 2024-05-09T01:45:20.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.311+0000 7f55f5d00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f55f00cdaa0 0x7f55f0157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.311+0000 7f55f5d00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f55f00ce4e0 0x7f55f00ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.311+0000 7f55f5d00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f00c7bf0 con 0x7f55f00ce0d0 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.311+0000 7f55f5d00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f55f00ce8f0 con 0x7f55f00ce4e0 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.311+0000 7f55f5d00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f55f00c79a0 con 0x7f55f00cdaa0 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55effff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f55f00ce4e0 0x7f55f00ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55eeffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f55f00ce0d0 0x7f55f0160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57374/0 (socket says 172.21.15.42:57374) 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55effff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f55f00ce4e0 0x7f55f00ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53448/0 (socket says 172.21.15.42:53448) 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55eeffd640 1 -- 172.21.15.42:0/1144481377 learned_addr learned my addr 172.21.15.42:0/1144481377 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55ef7fe640 1 --2- 172.21.15.42:0/1144481377 >> v2:172.21.15.181:3300/0 conn(0x7f55f00cdaa0 0x7f55f0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55effff640 1 -- 172.21.15.42:0/1144481377 >> v2:172.21.15.181:3300/0 conn(0x7f55f00cdaa0 msgr2=0x7f55f0157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:20.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55effff640 1 --2- 172.21.15.42:0/1144481377 >> v2:172.21.15.181:3300/0 conn(0x7f55f00cdaa0 0x7f55f0157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55effff640 1 -- 172.21.15.42:0/1144481377 >> v1:172.21.15.42:6789/0 conn(0x7f55f00ce0d0 legacy=0x7f55f0160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55effff640 1 -- 172.21.15.42:0/1144481377 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f00c7ed0 con 0x7f55f00ce4e0 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55ee7fc640 1 -- 172.21.15.42:0/1144481377 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656107663 0 0) 0x7f55f00c7bf0 con 0x7f55f00ce0d0 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.312+0000 7f55ef7fe640 1 --2- 172.21.15.42:0/1144481377 >> v2:172.21.15.181:3300/0 conn(0x7f55f00cdaa0 0x7f55f0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.313+0000 7f55effff640 1 --2- 172.21.15.42:0/1144481377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00ce4e0 0x7f55f00ceb00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f55f00cf710 tx=0x7f55e802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e9509d81b39ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.313+0000 7f55ee7fc640 1 -- 172.21.15.42:0/1144481377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8007740 con 0x7f55f00ce4e0 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.313+0000 7f55ee7fc640 1 -- 172.21.15.42:0/1144481377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e80078e0 con 0x7f55f00ce4e0 2024-05-09T01:45:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.313+0000 7f55ee7fc640 1 -- 172.21.15.42:0/1144481377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8007cb0 con 0x7f55f00ce4e0 2024-05-09T01:45:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.313+0000 7f55f5d00640 1 -- 172.21.15.42:0/1144481377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00ce4e0 msgr2=0x7f55f00ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.313+0000 7f55f5d00640 1 --2- 172.21.15.42:0/1144481377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00ce4e0 0x7f55f00ceb00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f55f00cf710 tx=0x7f55e802a680 comp rx=0 tx=0).stop 2024-05-09T01:45:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.314+0000 7f55f5d00640 1 -- 172.21.15.42:0/1144481377 shutdown_connections 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.314+0000 7f55f5d00640 1 --2- 172.21.15.42:0/1144481377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00ce4e0 0x7f55f00ceb00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.314+0000 7f55f5d00640 1 --2- 172.21.15.42:0/1144481377 >> v2:172.21.15.181:3300/0 conn(0x7f55f00cdaa0 0x7f55f0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.314+0000 7f55f5d00640 1 -- 172.21.15.42:0/1144481377 >> 172.21.15.42:0/1144481377 conn(0x7f55f0068610 msgr2=0x7f55f0068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.314+0000 7f55f5d00640 1 -- 172.21.15.42:0/1144481377 shutdown_connections 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.314+0000 7f55f5d00640 1 -- 172.21.15.42:0/1144481377 wait complete. 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.315+0000 7f55f5d00640 1 Processor -- start 2024-05-09T01:45:20.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.316+0000 7f55f5d00640 1 -- start start 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55f5d00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 0x7f55f01f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55f5d00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55f00ce0d0 0x7f55f015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55f5d00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f55f00ce4e0 0x7f55f01518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55f5d00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55f00c8770 con 0x7f55f00cdaa0 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55f5d00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f55f00c8490 con 0x7f55f00ce0d0 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55f5d00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f55f0160470 con 0x7f55f00ce4e0 2024-05-09T01:45:20.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 0x7f55f01f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 0x7f55f01f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53450/0 (socket says 172.21.15.42:53450) 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 -- 172.21.15.42:0/2845551214 learned_addr learned my addr 172.21.15.42:0/2845551214 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55eeffd640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55f00ce0d0 0x7f55f015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 -- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f55f00ce4e0 msgr2=0x7f55f01518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f55f00ce4e0 0x7f55f01518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 -- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55f00ce0d0 msgr2=0x7f55f015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55f00ce0d0 0x7f55f015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 -- 172.21.15.42:0/2845551214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f01f7570 con 0x7f55f00cdaa0 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55eeffd640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55f00ce0d0 0x7f55f015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:20.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55ef7fe640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 0x7f55f01f7030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f55e000d800 tx=0x7f55e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004030 con 0x7f55f00cdaa0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.317+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e00041d0 con 0x7f55f00cdaa0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.318+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e00096a0 con 0x7f55f00cdaa0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.318+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f014dd60 con 0x7f55f00cdaa0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.318+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f014da80 con 0x7f55f00cdaa0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.319+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f006ebb0 con 0x7f55f00cdaa0 2024-05-09T01:45:20.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.319+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55e0009840 con 0x7f55f00cdaa0 2024-05-09T01:45:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.320+0000 7f55d7fff640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f55dc0762d0 0x7f55dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.320+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f55e00979e0 con 0x7f55f00cdaa0 2024-05-09T01:45:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.321+0000 7f55eeffd640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f55dc0762d0 0x7f55dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.321+0000 7f55eeffd640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f55dc0762d0 0x7f55dc0787e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55f0154fb0 tx=0x7f55e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.325+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55f006ebb0 con 0x7f55f00cdaa0 2024-05-09T01:45:20.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.520+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f55f00b4e00 con 0x7f55dc0762d0 2024-05-09T01:45:20.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.520+0000 7f55d7fff640 1 -- 172.21.15.42:0/2845551214 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55f00b4e00 con 0x7f55dc0762d0 2024-05-09T01:45:20.518 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T01:45:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f55dc0762d0 msgr2=0x7f55dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f55dc0762d0 0x7f55dc0787e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55f0154fb0 tx=0x7f55e4009040 comp rx=0 tx=0).stop 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 msgr2=0x7f55f01f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 0x7f55f01f7030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f55e000d800 tx=0x7f55e000dcc0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 shutdown_connections 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f55dc0762d0 0x7f55dc0787e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f55f00ce4e0 0x7f55f01518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55f00ce0d0 0x7f55f015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 --2- 172.21.15.42:0/2845551214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55f00cdaa0 0x7f55f01f7030 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 >> 172.21.15.42:0/2845551214 conn(0x7f55f0068610 msgr2=0x7f55f0152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 shutdown_connections 2024-05-09T01:45:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.523+0000 7f55f5d00640 1 -- 172.21.15.42:0/2845551214 wait complete. 2024-05-09T01:45:20.532 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T01:45:20.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:20.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.654+0000 7f341cf72640 1 Processor -- start 2024-05-09T01:45:20.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.654+0000 7f341cf72640 1 -- start start 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.655+0000 7f341cf72640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 0x7f34180ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.655+0000 7f341cf72640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341806d860 con 0x7f341806e730 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.655+0000 7f341cf72640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34180cb850 con 0x7f34180cae90 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.655+0000 7f341cf72640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f34180cbb30 con 0x7f3418156ee0 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.655+0000 7f3416d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f341806e730 0x7f341815d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57380/0 (socket says 172.21.15.42:57380) 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.655+0000 7f3416d9d640 1 -- 172.21.15.42:0/4228396080 learned_addr learned my addr 172.21.15.42:0/4228396080 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341659c640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 0x7f34180ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101842513 0 0) 0x7f3408001110 con 0x7f341806e730 2024-05-09T01:45:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3404003520 con 0x7f341806e730 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361638247 0 0) 0x7f34180cb850 con 0x7f34180cae90 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3408001110 con 0x7f34180cae90 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2597498405 0 0) 0x7f3404003520 con 0x7f341806e730 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 msgr2=0x7f34180ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 0x7f34180ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 >> v1:172.21.15.181:6789/0 conn(0x7f34180cae90 legacy=0x7f3418072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34180cbe10 con 0x7f341806e730 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7f34080018c0 con 0x7f341806e730 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 >> v1:172.21.15.42:6789/0 conn(0x7f341806e730 legacy=0x7f341815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404003c10 0x7f3404004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3404004800 0x7f3404004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 0x7f34040052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f34180cbb30 con 0x7f3404004800 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f340400bbc0 con 0x7f3404003c10 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f340400bdc0 con 0x7f3418156ee0 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f3415d9b640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3404004800 0x7f3404004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f341659c640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404003c10 0x7f3404004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f3416d9d640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 0x7f34040052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f3415d9b640 1 -- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 msgr2=0x7f34040052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f3415d9b640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3418156ee0 0x7f34040052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f3415d9b640 1 -- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404003c10 msgr2=0x7f3404004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.656+0000 7f3415d9b640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404003c10 0x7f3404004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.657+0000 7f3415d9b640 1 -- 172.21.15.42:0/4228396080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3404003520 con 0x7f3404004800 2024-05-09T01:45:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.657+0000 7f3415d9b640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3404004800 0x7f3404004c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3400001900 tx=0x7f3404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32be7d562533f435 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.657+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400001520 con 0x7f3404004800 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.657+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340002acd0 con 0x7f3404004800 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.657+0000 7f341559a640 1 -- 172.21.15.42:0/4228396080 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400005310 con 0x7f3404004800 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f341cf72640 1 -- 172.21.15.42:0/4228396080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3404004800 msgr2=0x7f3404004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f341cf72640 1 --2- 172.21.15.42:0/4228396080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3404004800 0x7f3404004c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3400001900 tx=0x7f3404005830 comp rx=0 tx=0).stop 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f3416d9d640 1 -- 172.21.15.42:0/4228396080 reap_dead start 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f341cf72640 1 -- 172.21.15.42:0/4228396080 shutdown_connections 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f341cf72640 1 -- 172.21.15.42:0/4228396080 >> 172.21.15.42:0/4228396080 conn(0x7f341806c670 msgr2=0x7f341806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f341cf72640 1 -- 172.21.15.42:0/4228396080 shutdown_connections 2024-05-09T01:45:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.658+0000 7f341cf72640 1 -- 172.21.15.42:0/4228396080 wait complete. 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.660+0000 7f341cf72640 1 Processor -- start 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.660+0000 7f341cf72640 1 -- start start 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f341cf72640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404004800 0x7f34181f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f341cf72640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f34180d0b10 0x7f341814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f341cf72640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f341814a340 0x7f341814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f341cf72640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3418073390 con 0x7f341814a340 2024-05-09T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f341cf72640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34180cc3d0 con 0x7f3404004800 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f341cf72640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3418073510 con 0x7f34180d0b10 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.661+0000 7f3416d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f341814a340 0x7f341814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f341814a340 0x7f341814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53470/0 (socket says 172.21.15.42:53470) 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 -- 172.21.15.42:0/182443673 learned_addr learned my addr 172.21.15.42:0/182443673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3415d9b640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f34180d0b10 0x7f341814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f341659c640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404004800 0x7f34181f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 -- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f34180d0b10 msgr2=0x7f341814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f34180d0b10 0x7f341814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 -- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404004800 msgr2=0x7f34181f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3404004800 0x7f34181f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 -- 172.21.15.42:0/182443673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34181f69f0 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f3416d9d640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f341814a340 0x7f341814a750 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f34180cda40 tx=0x7f3408007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340800f910 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3408018070 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340800fd10 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34181f6cd0 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.662+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34181f7290 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.663+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34181f3a20 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.664+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3408026430 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f340effd640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f33f8076300 0x7f33f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f3408097bf0 con 0x7f341814a340 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f340effd640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f33f807e6d0 0x7f33f8080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f341659c640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f33f8076300 0x7f33f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 --> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3408014e90 con 0x7f33f807e6d0 2024-05-09T01:45:20.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f3408098080 con 0x7f341814a340 2024-05-09T01:45:20.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f3415d9b640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f33f807e6d0 0x7f33f8080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f341659c640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f33f8076300 0x7f33f8078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3410014430 tx=0x7f341000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.665+0000 7f3415d9b640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f33f807e6d0 0x7f33f8080ba0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.666+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== osd.5 v2:172.21.15.181:6824/3826879065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3408014e90 con 0x7f33f807e6d0 2024-05-09T01:45:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.679+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 --> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3418153be0 con 0x7f33f807e6d0 2024-05-09T01:45:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.680+0000 7f340effd640 1 -- 172.21.15.42:0/182443673 <== osd.5 v2:172.21.15.181:6824/3826879065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3418153be0 con 0x7f33f807e6d0 2024-05-09T01:45:20.678 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:20.678 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:20.678 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:20.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f33f807e6d0 msgr2=0x7f33f8080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6824/3826879065,v1:172.21.15.181:6825/3826879065] conn(0x7f33f807e6d0 0x7f33f8080ba0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f33f8076300 msgr2=0x7f33f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f33f8076300 0x7f33f8078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3410014430 tx=0x7f341000b040 comp rx=0 tx=0).stop 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f341814a340 msgr2=0x7f341814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 --2- 172.21.15.42:0/182443673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f341814a340 0x7f341814a750 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f34180cda40 tx=0x7f3408007720 comp rx=0 tx=0).stop 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f3416d9d640 1 -- 172.21.15.42:0/182443673 reap_dead start 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 shutdown_connections 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 >> 172.21.15.42:0/182443673 conn(0x7f341806c670 msgr2=0x7f341815d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 shutdown_connections 2024-05-09T01:45:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.681+0000 7f341cf72640 1 -- 172.21.15.42:0/182443673 wait complete. 2024-05-09T01:45:20.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T01:45:20.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.808+0000 7f3631070640 1 Processor -- start 2024-05-09T01:45:20.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.808+0000 7f3631070640 1 -- start start 2024-05-09T01:45:20.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3631070640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c06e990 0x7f362c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3631070640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0ce880 con 0x7f362c0cd270 2024-05-09T01:45:20.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3631070640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c15d7f0 con 0x7f362c0c7020 2024-05-09T01:45:20.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3631070640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f362c0ccb00 con 0x7f362c06e990 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f362b59e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f362c0cd270 0x7f362c0cd680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57384/0 (socket says 172.21.15.42:57384) 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f362b59e640 1 -- 172.21.15.42:0/2115816553 learned_addr learned my addr 172.21.15.42:0/2115816553 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f362a59c640 1 --2- 172.21.15.42:0/2115816553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c06e990 0x7f362c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172634338 0 0) 0x7f362c0ce880 con 0x7f362c0cd270 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3618003520 con 0x7f362c0cd270 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518121148 0 0) 0x7f362c15d7f0 con 0x7f362c0c7020 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362c0ce880 con 0x7f362c0c7020 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f362a59c640 1 -- 172.21.15.42:0/2115816553 >> v1:172.21.15.181:6789/0 conn(0x7f362c0c7020 legacy=0x7f362c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f362a59c640 1 -- 172.21.15.42:0/2115816553 >> v1:172.21.15.42:6789/0 conn(0x7f362c0cd270 legacy=0x7f362c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.810+0000 7f362a59c640 1 -- 172.21.15.42:0/2115816553 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c0ce020 con 0x7f362c06e990 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.811+0000 7f362a59c640 1 --2- 172.21.15.42:0/2115816553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c06e990 0x7f362c156d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36140097d0 tx=0x7f361402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bddce8d0ed14096 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.811+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614037070 con 0x7f362c06e990 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.811+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3614032440 con 0x7f362c06e990 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.811+0000 7f3629d9b640 1 -- 172.21.15.42:0/2115816553 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614032810 con 0x7f362c06e990 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 -- 172.21.15.42:0/2115816553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c06e990 msgr2=0x7f362c156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 --2- 172.21.15.42:0/2115816553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c06e990 0x7f362c156d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36140097d0 tx=0x7f361402a180 comp rx=0 tx=0).stop 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 -- 172.21.15.42:0/2115816553 shutdown_connections 2024-05-09T01:45:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 --2- 172.21.15.42:0/2115816553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c06e990 0x7f362c156d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 -- 172.21.15.42:0/2115816553 >> 172.21.15.42:0/2115816553 conn(0x7f362c068ef0 msgr2=0x7f362c0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 -- 172.21.15.42:0/2115816553 shutdown_connections 2024-05-09T01:45:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.812+0000 7f3631070640 1 -- 172.21.15.42:0/2115816553 wait complete. 2024-05-09T01:45:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.814+0000 7f3631070640 1 Processor -- start 2024-05-09T01:45:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.814+0000 7f3631070640 1 -- start start 2024-05-09T01:45:20.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.815+0000 7f3631070640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 0x7f362c1f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.815+0000 7f3631070640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c0c7020 0x7f362c1e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.815+0000 7f3631070640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f362c0cd270 0x7f362c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f3631070640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f362c15da90 con 0x7f362c06e990 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f3631070640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f362c0ccde0 con 0x7f362c0cd270 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f3631070640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f362c06dcc0 con 0x7f362c0c7020 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 0x7f362c1f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 0x7f362c1f3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53478/0 (socket says 172.21.15.42:53478) 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 -- 172.21.15.42:0/1935032595 learned_addr learned my addr 172.21.15.42:0/1935032595 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362a59c640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c0c7020 0x7f362c1e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362b59e640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f362c0cd270 0x7f362c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 -- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c0c7020 msgr2=0x7f362c1e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c0c7020 0x7f362c1e9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 -- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f362c0cd270 msgr2=0x7f362c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f362c0cd270 0x7f362c14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 -- 172.21.15.42:0/1935032595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c0d0740 con 0x7f362c06e990 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f362ad9d640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 0x7f362c1f3a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f361c00c7a0 tx=0x7f361c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c003b70 con 0x7f362c06e990 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c003d10 con 0x7f362c06e990 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c1f3f40 con 0x7f362c06e990 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c00aa90 con 0x7f362c06e990 2024-05-09T01:45:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.816+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c1f7230 con 0x7f362c06e990 2024-05-09T01:45:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.817+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c0d0910 con 0x7f362c06e990 2024-05-09T01:45:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.818+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f361c00ac30 con 0x7f362c06e990 2024-05-09T01:45:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.819+0000 7f36237fe640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f360c0762d0 0x7f360c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.819+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f361c0974b0 con 0x7f362c06e990 2024-05-09T01:45:20.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.819+0000 7f362a59c640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f360c0762d0 0x7f360c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:20.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.819+0000 7f362a59c640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f360c0762d0 0x7f360c0787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3614034000 tx=0x7f361402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:20.824+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f361c060740 con 0x7f362c06e990 2024-05-09T01:45:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.018+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f362c1f6fe0 con 0x7f360c0762d0 2024-05-09T01:45:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.019+0000 7f36237fe640 1 -- 172.21.15.42:0/1935032595 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f362c1f6fe0 con 0x7f360c0762d0 2024-05-09T01:45:21.016 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T01:45:21.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f360c0762d0 msgr2=0x7f360c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f360c0762d0 0x7f360c0787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3614034000 tx=0x7f361402e000 comp rx=0 tx=0).stop 2024-05-09T01:45:21.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 msgr2=0x7f362c1f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 0x7f362c1f3a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f361c00c7a0 tx=0x7f361c00cc60 comp rx=0 tx=0).stop 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 shutdown_connections 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f360c0762d0 0x7f360c0787e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f362c0cd270 0x7f362c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f362c0c7020 0x7f362c1e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 --2- 172.21.15.42:0/1935032595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f362c06e990 0x7f362c1f3a00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 >> 172.21.15.42:0/1935032595 conn(0x7f362c068ef0 msgr2=0x7f362c0b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 shutdown_connections 2024-05-09T01:45:21.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.021+0000 7f3631070640 1 -- 172.21.15.42:0/1935032595 wait complete. 2024-05-09T01:45:21.031 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T01:45:21.031 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.152+0000 7f105139d640 1 Processor -- start 2024-05-09T01:45:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.152+0000 7f105139d640 1 -- start start 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.153+0000 7f105139d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f104c0c7780 0x7f104c0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f105139d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 0x7f104c167b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f105139d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c15cf90 con 0x7f104c0b4e90 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f105139d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f104c0ce890 con 0x7f104c0c7780 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f105139d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f104c0ccbc0 con 0x7f104c1656f0 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104b7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 0x7f104c167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f104c0c7780 0x7f104c0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104b7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 0x7f104c167b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:33540/0 (socket says 172.21.15.42:33540) 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f104c0c7780 0x7f104c0cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:56974/0 (socket says 172.21.15.42:56974) 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104b7fe640 1 -- 172.21.15.42:0/3127701937 learned_addr learned my addr 172.21.15.42:0/3127701937 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104a7fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f104c0b4e90 0x7f104c06d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:52042/0 (socket says 172.21.15.42:52042) 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104affd640 1 -- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 msgr2=0x7f104c167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104affd640 1 --2- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 0x7f104c167b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104affd640 1 -- 172.21.15.42:0/3127701937 >> v1:172.21.15.181:6789/0 conn(0x7f104c0b4e90 legacy=0x7f104c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104affd640 1 -- 172.21.15.42:0/3127701937 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c0cce10 con 0x7f104c0c7780 2024-05-09T01:45:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.154+0000 7f104b7fe640 1 --2- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 0x7f104c167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.155+0000 7f104affd640 1 --2- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 0x7f104c0cd8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10440097a0 tx=0x7f104402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83eb438d85c0da8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.155+0000 7f1049ffb640 1 -- 172.21.15.42:0/3127701937 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044037070 con 0x7f104c0c7780 2024-05-09T01:45:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f1049ffb640 1 -- 172.21.15.42:0/3127701937 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104402ae50 con 0x7f104c0c7780 2024-05-09T01:45:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f1049ffb640 1 -- 172.21.15.42:0/3127701937 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044032660 con 0x7f104c0c7780 2024-05-09T01:45:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 -- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 msgr2=0x7f104c0cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 --2- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 0x7f104c0cd8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10440097a0 tx=0x7f104402a100 comp rx=0 tx=0).stop 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 -- 172.21.15.42:0/3127701937 shutdown_connections 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 --2- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c1656f0 0x7f104c167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 --2- 172.21.15.42:0/3127701937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 0x7f104c0cd8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 -- 172.21.15.42:0/3127701937 >> 172.21.15.42:0/3127701937 conn(0x7f104c068e00 msgr2=0x7f104c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 -- 172.21.15.42:0/3127701937 shutdown_connections 2024-05-09T01:45:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.156+0000 7f105139d640 1 -- 172.21.15.42:0/3127701937 wait complete. 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.158+0000 7f105139d640 1 Processor -- start 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.158+0000 7f105139d640 1 -- start start 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f105139d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c0b4e90 0x7f104c1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f105139d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 0x7f104c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f105139d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f104c1656f0 0x7f104c1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f105139d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0ce530 con 0x7f104c1656f0 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f105139d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0cd460 con 0x7f104c0c7780 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f105139d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f104c157350 con 0x7f104c0b4e90 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.159+0000 7f104b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f104c1656f0 0x7f104c1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f104c1656f0 0x7f104c1f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53480/0 (socket says 172.21.15.42:53480) 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 -- 172.21.15.42:0/3275462268 learned_addr learned my addr 172.21.15.42:0/3275462268 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104a7fc640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 0x7f104c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104affd640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c0b4e90 0x7f104c1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 -- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c0b4e90 msgr2=0x7f104c1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f104c0b4e90 0x7f104c1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 -- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 msgr2=0x7f104c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f104c0c7780 0x7f104c158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 -- 172.21.15.42:0/3275462268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c159f00 con 0x7f104c1656f0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f104b7fe640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f104c1656f0 0x7f104c1f3b80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f103c00ef90 tx=0x7f103c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c00cbe0 con 0x7f104c1656f0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c00cd80 con 0x7f104c1656f0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c1594c0 con 0x7f104c1656f0 2024-05-09T01:45:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c003bd0 con 0x7f104c1656f0 2024-05-09T01:45:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.160+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c1584b0 con 0x7f104c1656f0 2024-05-09T01:45:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.161+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f104c14c750 con 0x7f104c1656f0 2024-05-09T01:45:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.162+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f103c01b030 con 0x7f104c1656f0 2024-05-09T01:45:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.162+0000 7f10437fe640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f102c0762d0 0x7f102c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.162+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f103c0978a0 con 0x7f104c1656f0 2024-05-09T01:45:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f10437fe640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f102c07e6c0 0x7f102c080b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 --> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f103c009b10 con 0x7f102c07e6c0 2024-05-09T01:45:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f103c09c280 con 0x7f104c1656f0 2024-05-09T01:45:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f104affd640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f102c0762d0 0x7f102c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f104a7fc640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f102c07e6c0 0x7f102c080b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f104affd640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f102c0762d0 0x7f102c0787e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1044034000 tx=0x7f104402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.163+0000 7f104a7fc640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f102c07e6c0 0x7f102c080b90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.164+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== osd.6 v2:172.21.15.181:6816/727737785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f103c009b10 con 0x7f102c07e6c0 2024-05-09T01:45:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.177+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 --> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f104c157f20 con 0x7f102c07e6c0 2024-05-09T01:45:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.178+0000 7f10437fe640 1 -- 172.21.15.42:0/3275462268 <== osd.6 v2:172.21.15.181:6816/727737785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f104c157f20 con 0x7f102c07e6c0 2024-05-09T01:45:21.176 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:21.176 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:21.176 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f102c07e6c0 msgr2=0x7f102c080b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6816/727737785,v1:172.21.15.181:6817/727737785] conn(0x7f102c07e6c0 0x7f102c080b90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f102c0762d0 msgr2=0x7f102c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f102c0762d0 0x7f102c0787e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1044034000 tx=0x7f104402e000 comp rx=0 tx=0).stop 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f104c1656f0 msgr2=0x7f104c1f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 --2- 172.21.15.42:0/3275462268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f104c1656f0 0x7f104c1f3b80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f103c00ef90 tx=0x7f103c00c490 comp rx=0 tx=0).stop 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f104b7fe640 1 -- 172.21.15.42:0/3275462268 reap_dead start 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 shutdown_connections 2024-05-09T01:45:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 >> 172.21.15.42:0/3275462268 conn(0x7f104c068e00 msgr2=0x7f104c14f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 shutdown_connections 2024-05-09T01:45:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.179+0000 7f105139d640 1 -- 172.21.15.42:0/3275462268 wait complete. 2024-05-09T01:45:21.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T01:45:21.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.306+0000 7fbb29a3b640 1 Processor -- start 2024-05-09T01:45:21.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.306+0000 7fbb29a3b640 1 -- start start 2024-05-09T01:45:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb29a3b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb24073a30 0x7fbb240c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb29a3b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb240ceea0 0x7fbb240c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb29a3b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb24074120 con 0x7fbb24153c90 2024-05-09T01:45:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb29a3b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbb24074400 con 0x7fbb24073a30 2024-05-09T01:45:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb29a3b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbb240746e0 con 0x7fbb240ceea0 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb22ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb24073a30 0x7fbb240c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb237fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbb24153c90 0x7fbb24160a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57400/0 (socket says 172.21.15.42:57400) 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb237fe640 1 -- 172.21.15.42:0/4178010200 learned_addr learned my addr 172.21.15.42:0/4178010200 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb227fc640 1 --2- 172.21.15.42:0/4178010200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb240ceea0 0x7fbb240c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb22ffd640 1 -- 172.21.15.42:0/4178010200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb240ceea0 msgr2=0x7fbb240c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb22ffd640 1 --2- 172.21.15.42:0/4178010200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb240ceea0 0x7fbb240c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb22ffd640 1 -- 172.21.15.42:0/4178010200 >> v1:172.21.15.42:6789/0 conn(0x7fbb24153c90 legacy=0x7fbb24160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.307+0000 7fbb21ffb640 1 -- 172.21.15.42:0/4178010200 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426221635 0 0) 0x7fbb24074120 con 0x7fbb24153c90 2024-05-09T01:45:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.308+0000 7fbb22ffd640 1 -- 172.21.15.42:0/4178010200 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb24160510 con 0x7fbb24073a30 2024-05-09T01:45:21.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.308+0000 7fbb22ffd640 1 --2- 172.21.15.42:0/4178010200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb240c8670 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009d90 tx=0x7fbb1402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fde511339c81b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.308+0000 7fbb21ffb640 1 -- 172.21.15.42:0/4178010200 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14031600 con 0x7fbb24073a30 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.308+0000 7fbb21ffb640 1 -- 172.21.15.42:0/4178010200 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb140317a0 con 0x7fbb24073a30 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.308+0000 7fbb21ffb640 1 -- 172.21.15.42:0/4178010200 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14031b70 con 0x7fbb24073a30 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 -- 172.21.15.42:0/4178010200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 msgr2=0x7fbb240c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/4178010200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb240c8670 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009d90 tx=0x7fbb1402a5d0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 -- 172.21.15.42:0/4178010200 shutdown_connections 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/4178010200 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb240ceea0 0x7fbb240c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/4178010200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb240c8670 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 -- 172.21.15.42:0/4178010200 >> 172.21.15.42:0/4178010200 conn(0x7fbb24071620 msgr2=0x7fbb24071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 -- 172.21.15.42:0/4178010200 shutdown_connections 2024-05-09T01:45:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.309+0000 7fbb29a3b640 1 -- 172.21.15.42:0/4178010200 wait complete. 2024-05-09T01:45:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.311+0000 7fbb29a3b640 1 Processor -- start 2024-05-09T01:45:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.311+0000 7fbb29a3b640 1 -- start start 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb29a3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb241f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb29a3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb240ceea0 0x7fbb2414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb29a3b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb24153c90 0x7fbb2414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb29a3b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240ca440 con 0x7fbb24073a30 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb29a3b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240ca2c0 con 0x7fbb240ceea0 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb29a3b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbb24161140 con 0x7fbb24153c90 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb22ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb241f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb22ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb241f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53490/0 (socket says 172.21.15.42:53490) 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.312+0000 7fbb22ffd640 1 -- 172.21.15.42:0/2754607177 learned_addr learned my addr 172.21.15.42:0/2754607177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb227fc640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb240ceea0 0x7fbb2414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb237fe640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb24153c90 0x7fbb2414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb22ffd640 1 -- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb24153c90 msgr2=0x7fbb2414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb22ffd640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb24153c90 0x7fbb2414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb22ffd640 1 -- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb240ceea0 msgr2=0x7fbb2414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb22ffd640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb240ceea0 0x7fbb2414edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb22ffd640 1 -- 172.21.15.42:0/2754607177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb241f3cc0 con 0x7fbb24073a30 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb22ffd640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb241f3780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009d90 tx=0x7fbb14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1403f070 con 0x7fbb24073a30 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb14030be0 con 0x7fbb24073a30 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb241f6cd0 con 0x7fbb24073a30 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14009450 con 0x7fbb24073a30 2024-05-09T01:45:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.313+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb241f7290 con 0x7fbb24073a30 2024-05-09T01:45:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.314+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb240768d0 con 0x7fbb24073a30 2024-05-09T01:45:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.315+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb14031650 con 0x7fbb24073a30 2024-05-09T01:45:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.316+0000 7fbb1bfff640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbb040762d0 0x7fbb040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.316+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fbb140b8bb0 con 0x7fbb24073a30 2024-05-09T01:45:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.316+0000 7fbb227fc640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbb040762d0 0x7fbb040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.316+0000 7fbb227fc640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbb040762d0 0x7fbb040787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c006fd0 tx=0x7fbb0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.319+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbb14082400 con 0x7fbb24073a30 2024-05-09T01:45:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.513+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbb240cf680 con 0x7fbb040762d0 2024-05-09T01:45:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.513+0000 7fbb1bfff640 1 -- 172.21.15.42:0/2754607177 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbb240cf680 con 0x7fbb040762d0 2024-05-09T01:45:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T01:45:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbb040762d0 msgr2=0x7fbb040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbb040762d0 0x7fbb040787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c006fd0 tx=0x7fbb0c008040 comp rx=0 tx=0).stop 2024-05-09T01:45:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 msgr2=0x7fbb241f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb241f3780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009d90 tx=0x7fbb14004a40 comp rx=0 tx=0).stop 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 shutdown_connections 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fbb040762d0 0x7fbb040787e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb24153c90 0x7fbb2414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb240ceea0 0x7fbb2414edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 --2- 172.21.15.42:0/2754607177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb24073a30 0x7fbb241f3780 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 >> 172.21.15.42:0/2754607177 conn(0x7fbb24071620 msgr2=0x7fbb24075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 shutdown_connections 2024-05-09T01:45:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.515+0000 7fbb29a3b640 1 -- 172.21.15.42:0/2754607177 wait complete. 2024-05-09T01:45:21.525 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T01:45:21.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T01:45:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.646+0000 7fd55e496640 1 Processor -- start 2024-05-09T01:45:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.646+0000 7fd55e496640 1 -- start start 2024-05-09T01:45:21.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.647+0000 7fd55e496640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 0x7fd558153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.647+0000 7fd55e496640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd5580ca240 0x7fd55815d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.647+0000 7fd55e496640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5580c9e40 con 0x7fd5580cf920 2024-05-09T01:45:21.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.647+0000 7fd55e496640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd558159d40 con 0x7fd5580ca240 2024-05-09T01:45:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.647+0000 7fd55e496640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd55815a000 con 0x7fd5580cc670 2024-05-09T01:45:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 0x7fd558153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd55ca33640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd5580ca240 0x7fd55815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 0x7fd558153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:33568/0 (socket says 172.21.15.42:33568) 2024-05-09T01:45:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 -- 172.21.15.42:0/2715118719 learned_addr learned my addr 172.21.15.42:0/2715118719 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd5577fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd5580cf920 0x7fd5580c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:52052/0 (socket says 172.21.15.42:52052) 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 -- 172.21.15.42:0/2715118719 >> v2:172.21.15.181:3300/0 conn(0x7fd5580ca240 msgr2=0x7fd55815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 --2- 172.21.15.42:0/2715118719 >> v2:172.21.15.181:3300/0 conn(0x7fd5580ca240 0x7fd55815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 -- 172.21.15.42:0/2715118719 >> v1:172.21.15.181:6789/0 conn(0x7fd5580cf920 legacy=0x7fd5580c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd557fff640 1 -- 172.21.15.42:0/2715118719 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55815a2e0 con 0x7fd5580cc670 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.648+0000 7fd55ca33640 1 --2- 172.21.15.42:0/2715118719 >> v2:172.21.15.181:3300/0 conn(0x7fd5580ca240 0x7fd55815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.649+0000 7fd557fff640 1 --2- 172.21.15.42:0/2715118719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 0x7fd558153e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd548009870 tx=0x7fd54802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a2618f36dcfce7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.649+0000 7fd556ffd640 1 -- 172.21.15.42:0/2715118719 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548037070 con 0x7fd5580cc670 2024-05-09T01:45:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.649+0000 7fd556ffd640 1 -- 172.21.15.42:0/2715118719 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd548032440 con 0x7fd5580cc670 2024-05-09T01:45:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.649+0000 7fd556ffd640 1 -- 172.21.15.42:0/2715118719 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548032810 con 0x7fd5580cc670 2024-05-09T01:45:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 -- 172.21.15.42:0/2715118719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 msgr2=0x7fd558153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 --2- 172.21.15.42:0/2715118719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 0x7fd558153e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd548009870 tx=0x7fd54802a250 comp rx=0 tx=0).stop 2024-05-09T01:45:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 -- 172.21.15.42:0/2715118719 shutdown_connections 2024-05-09T01:45:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 --2- 172.21.15.42:0/2715118719 >> v2:172.21.15.181:3300/0 conn(0x7fd5580ca240 0x7fd55815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 --2- 172.21.15.42:0/2715118719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5580cc670 0x7fd558153e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 -- 172.21.15.42:0/2715118719 >> 172.21.15.42:0/2715118719 conn(0x7fd55806dba0 msgr2=0x7fd55806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 -- 172.21.15.42:0/2715118719 shutdown_connections 2024-05-09T01:45:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.650+0000 7fd55e496640 1 -- 172.21.15.42:0/2715118719 wait complete. 2024-05-09T01:45:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.652+0000 7fd55e496640 1 Processor -- start 2024-05-09T01:45:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.652+0000 7fd55e496640 1 -- start start 2024-05-09T01:45:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd55e496640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5580ca240 0x7fd5581f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd55e496640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5580cf920 0x7fd558149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd55e496640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd55815b660 0x7fd558158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd55e496640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5580c91a0 con 0x7fd5580ca240 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd55e496640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd55815a8a0 con 0x7fd5580cf920 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd55e496640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd5580c9320 con 0x7fd55815b660 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd557fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5580ca240 0x7fd5581f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd557fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5580ca240 0x7fd5581f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53502/0 (socket says 172.21.15.42:53502) 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.653+0000 7fd557fff640 1 -- 172.21.15.42:0/2959395104 learned_addr learned my addr 172.21.15.42:0/2959395104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd5577fe640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5580cf920 0x7fd558149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd55ca33640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd55815b660 0x7fd558158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd557fff640 1 -- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd55815b660 msgr2=0x7fd558158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd557fff640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd55815b660 0x7fd558158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd557fff640 1 -- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5580cf920 msgr2=0x7fd558149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd557fff640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5580cf920 0x7fd558149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd557fff640 1 -- 172.21.15.42:0/2959395104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55814f650 con 0x7fd5580ca240 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd557fff640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5580ca240 0x7fd5581f1ab0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd548000c00 tx=0x7fd5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548037040 con 0x7fd5580ca240 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd548042070 con 0x7fd5580ca240 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5480308a0 con 0x7fd5580ca240 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd558071c10 con 0x7fd5580ca240 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.654+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55814fbd0 con 0x7fd5580ca240 2024-05-09T01:45:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.655+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5580cfe20 con 0x7fd5580ca240 2024-05-09T01:45:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.656+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd548030a40 con 0x7fd5580ca240 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.656+0000 7fd554ff9640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd544076300 0x7fd544078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd5480b88b0 con 0x7fd5580ca240 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd5577fe640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd544076300 0x7fd544078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd554ff9640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7fd54407e6d0 0x7fd544080ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 --> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd548051e50 con 0x7fd54407e6d0 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd5480b8c60 con 0x7fd5580ca240 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd55ca33640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7fd54407e6d0 0x7fd544080ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd5577fe640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd544076300 0x7fd544078810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5580ca9c0 tx=0x7fd54c000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.657+0000 7fd55ca33640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7fd54407e6d0 0x7fd544080ba0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.658+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== osd.7 v2:172.21.15.181:6808/3827658741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd548051e50 con 0x7fd54407e6d0 2024-05-09T01:45:21.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.672+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 --> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd5580ca020 con 0x7fd54407e6d0 2024-05-09T01:45:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.672+0000 7fd554ff9640 1 -- 172.21.15.42:0/2959395104 <== osd.7 v2:172.21.15.181:6808/3827658741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd5580ca020 con 0x7fd54407e6d0 2024-05-09T01:45:21.670 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-09T01:45:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T01:45:21.670 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-09T01:45:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7fd54407e6d0 msgr2=0x7fd544080ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6808/3827658741,v1:172.21.15.181:6809/3827658741] conn(0x7fd54407e6d0 0x7fd544080ba0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd544076300 msgr2=0x7fd544078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fd544076300 0x7fd544078810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5580ca9c0 tx=0x7fd54c000bc0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5580ca240 msgr2=0x7fd5581f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 --2- 172.21.15.42:0/2959395104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5580ca240 0x7fd5581f1ab0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd548000c00 tx=0x7fd5480046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55ca33640 1 -- 172.21.15.42:0/2959395104 reap_dead start 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 shutdown_connections 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 >> 172.21.15.42:0/2959395104 conn(0x7fd55806dba0 msgr2=0x7fd5580ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 shutdown_connections 2024-05-09T01:45:21.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.673+0000 7fd55e496640 1 -- 172.21.15.42:0/2959395104 wait complete. 2024-05-09T01:45:21.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T01:45:21.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.800+0000 7f4d7c500640 1 Processor -- start 2024-05-09T01:45:21.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.800+0000 7f4d7c500640 1 -- start start 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.801+0000 7f4d7c500640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d740cdaa0 0x7f4d74157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.801+0000 7f4d7c500640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740ce4e0 0x7f4d740ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.801+0000 7f4d7c500640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d740c7bf0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.801+0000 7f4d7c500640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4d740ce8f0 con 0x7f4d740cdaa0 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.801+0000 7f4d7c500640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d740c79a0 con 0x7f4d740ce4e0 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7aa9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740ce4e0 0x7f4d740ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7a29c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d740cdaa0 0x7f4d74157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7aa9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740ce4e0 0x7f4d740ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.42:33578/0 (socket says 172.21.15.42:33578) 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7a29c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d740cdaa0 0x7f4d74157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57034/0 (socket says 172.21.15.42:57034) 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d79a9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4d740ce0d0 0x7f4d74160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.42:52062/0 (socket says 172.21.15.42:52062) 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7aa9d640 1 -- 172.21.15.42:0/2873113172 learned_addr learned my addr 172.21.15.42:0/2873113172 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7a29c640 1 -- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740ce4e0 msgr2=0x7f4d740ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7a29c640 1 --2- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740ce4e0 0x7f4d740ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7a29c640 1 -- 172.21.15.42:0/2873113172 >> v1:172.21.15.181:6789/0 conn(0x7f4d740ce0d0 legacy=0x7f4d74160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7a29c640 1 -- 172.21.15.42:0/2873113172 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d740c7ed0 con 0x7f4d740cdaa0 2024-05-09T01:45:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.802+0000 7f4d7929a640 1 -- 172.21.15.42:0/2873113172 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836885839 0 0) 0x7f4d740c7bf0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.803+0000 7f4d7a29c640 1 --2- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740cdaa0 0x7f4d74157100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097a0 tx=0x7f4d7002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a034b9a04a3d39c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.803+0000 7f4d7929a640 1 -- 172.21.15.42:0/2873113172 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70037070 con 0x7f4d740cdaa0 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.803+0000 7f4d7929a640 1 -- 172.21.15.42:0/2873113172 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d70032440 con 0x7f4d740cdaa0 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.803+0000 7f4d7929a640 1 -- 172.21.15.42:0/2873113172 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70032810 con 0x7f4d740cdaa0 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 -- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740cdaa0 msgr2=0x7f4d74157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 --2- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740cdaa0 0x7f4d74157100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097a0 tx=0x7f4d7002a180 comp rx=0 tx=0).stop 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 -- 172.21.15.42:0/2873113172 shutdown_connections 2024-05-09T01:45:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 --2- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740ce4e0 0x7f4d740ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 --2- 172.21.15.42:0/2873113172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740cdaa0 0x7f4d74157100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 -- 172.21.15.42:0/2873113172 >> 172.21.15.42:0/2873113172 conn(0x7f4d74068610 msgr2=0x7f4d74068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 -- 172.21.15.42:0/2873113172 shutdown_connections 2024-05-09T01:45:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.804+0000 7f4d7c500640 1 -- 172.21.15.42:0/2873113172 wait complete. 2024-05-09T01:45:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.806+0000 7f4d7c500640 1 Processor -- start 2024-05-09T01:45:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.806+0000 7f4d7c500640 1 -- start start 2024-05-09T01:45:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7c500640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740cdaa0 0x7f4d741f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7c500640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 0x7f4d7414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7c500640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740ce4e0 0x7f4d740d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7c500640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d740c8770 con 0x7f4d740ce0d0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7c500640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d740c8490 con 0x7f4d740ce4e0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7c500640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d74160470 con 0x7f4d740cdaa0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d79a9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 0x7f4d7414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d79a9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 0x7f4d7414ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53512/0 (socket says 172.21.15.42:53512) 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d79a9b640 1 -- 172.21.15.42:0/3645942088 learned_addr learned my addr 172.21.15.42:0/3645942088 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7a29c640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740cdaa0 0x7f4d741f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.807+0000 7f4d7aa9d640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740ce4e0 0x7f4d740d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d79a9b640 1 -- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740cdaa0 msgr2=0x7f4d741f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d79a9b640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740cdaa0 0x7f4d741f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d79a9b640 1 -- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740ce4e0 msgr2=0x7f4d740d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d79a9b640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740ce4e0 0x7f4d740d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d79a9b640 1 -- 172.21.15.42:0/3645942088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d741f7640 con 0x7f4d740ce0d0 2024-05-09T01:45:21.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d7a29c640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740cdaa0 0x7f4d741f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d7aa9d640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740ce4e0 0x7f4d740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d79a9b640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 0x7f4d7414ea80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c410 tx=0x7f4d6400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d640074e0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d640047e0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64004bd0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d740cabd0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.808+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d740cb190 con 0x7f4d740ce0d0 2024-05-09T01:45:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.809+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d740ca940 con 0x7f4d740ce0d0 2024-05-09T01:45:21.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.810+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d64011070 con 0x7f4d740ce0d0 2024-05-09T01:45:21.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.810+0000 7f4d6affd640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d58076300 0x7f4d58078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:21.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.811+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4d640972a0 con 0x7f4d740ce0d0 2024-05-09T01:45:21.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.811+0000 7f4d7a29c640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d58076300 0x7f4d58078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:21.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.811+0000 7f4d7a29c640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d58076300 0x7f4d58078810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d70034000 tx=0x7f4d7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:21.815+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4d64060af0 con 0x7f4d740ce0d0 2024-05-09T01:45:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.008+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f4d741526c0 con 0x7f4d58076300 2024-05-09T01:45:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.009+0000 7f4d6affd640 1 -- 172.21.15.42:0/3645942088 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4d741526c0 con 0x7f4d58076300 2024-05-09T01:45:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T01:45:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d58076300 msgr2=0x7f4d58078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d58076300 0x7f4d58078810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d70034000 tx=0x7f4d7002e000 comp rx=0 tx=0).stop 2024-05-09T01:45:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 msgr2=0x7f4d7414ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 0x7f4d7414ea80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c410 tx=0x7f4d6400c8d0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 shutdown_connections 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f4d58076300 0x7f4d58078810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d740ce4e0 0x7f4d740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d740ce0d0 0x7f4d7414ea80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 --2- 172.21.15.42:0/3645942088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d740cdaa0 0x7f4d741f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 >> 172.21.15.42:0/3645942088 conn(0x7f4d74068610 msgr2=0x7f4d7414b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 shutdown_connections 2024-05-09T01:45:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.011+0000 7f4d7c500640 1 -- 172.21.15.42:0/3645942088 wait complete. 2024-05-09T01:45:22.020 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:45:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.138+0000 7f6f58e69640 1 Processor -- start 2024-05-09T01:45:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.138+0000 7f6f58e69640 1 -- start start 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f58e69640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f540caf80 0x7f6f540ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f58e69640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f54160420 con 0x7f6f540c9500 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f58e69640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f541606e0 con 0x7f6f540b7ba0 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f58e69640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6f541612f0 con 0x7f6f540caf80 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f52d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f540caf80 0x7f6f540ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f5259c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6f540c9500 0x7f6f540c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57414/0 (socket says 172.21.15.42:57414) 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f5259c640 1 -- 172.21.15.42:0/2818621350 learned_addr learned my addr 172.21.15.42:0/2818621350 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2818621350 >> v1:172.21.15.181:6789/0 conn(0x7f6f540b7ba0 legacy=0x7f6f540ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2818621350 >> v1:172.21.15.42:6789/0 conn(0x7f6f540c9500 legacy=0x7f6f540c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2818621350 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f541609c0 con 0x7f6f540caf80 2024-05-09T01:45:22.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.140+0000 7f6f5159a640 1 -- 172.21.15.42:0/2818621350 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2925143125 0 0) 0x7f6f54160420 con 0x7f6f540c9500 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.141+0000 7f6f52d9d640 1 --2- 172.21.15.42:0/2818621350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f540ce4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097a0 tx=0x7f6f4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0911d292be11abe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.141+0000 7f6f5159a640 1 -- 172.21.15.42:0/2818621350 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44037070 con 0x7f6f540caf80 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.141+0000 7f6f5159a640 1 -- 172.21.15.42:0/2818621350 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44032440 con 0x7f6f540caf80 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.141+0000 7f6f5159a640 1 -- 172.21.15.42:0/2818621350 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44032810 con 0x7f6f540caf80 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 -- 172.21.15.42:0/2818621350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 msgr2=0x7f6f540ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2818621350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f540ce4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097a0 tx=0x7f6f4402a230 comp rx=0 tx=0).stop 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 -- 172.21.15.42:0/2818621350 shutdown_connections 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2818621350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f540ce4b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 -- 172.21.15.42:0/2818621350 >> 172.21.15.42:0/2818621350 conn(0x7f6f540d2100 msgr2=0x7f6f540d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 -- 172.21.15.42:0/2818621350 shutdown_connections 2024-05-09T01:45:22.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.142+0000 7f6f58e69640 1 -- 172.21.15.42:0/2818621350 wait complete. 2024-05-09T01:45:22.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.144+0000 7f6f58e69640 1 Processor -- start 2024-05-09T01:45:22.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.144+0000 7f6f58e69640 1 -- start start 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f58e69640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f540b7ba0 0x7f6f54151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f58e69640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f540c9500 0x7f6f541546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f58e69640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f5414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f58e69640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54160f80 con 0x7f6f540caf80 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f58e69640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f540cc350 con 0x7f6f540c9500 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f58e69640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f540ca190 con 0x7f6f540b7ba0 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f5414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f5414fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53538/0 (socket says 172.21.15.42:53538) 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2149397002 learned_addr learned my addr 172.21.15.42:0/2149397002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f51d9b640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f540c9500 0x7f6f541546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f5259c640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f540b7ba0 0x7f6f54151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f540b7ba0 msgr2=0x7f6f54151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f540b7ba0 0x7f6f54151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f540c9500 msgr2=0x7f6f541546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f540c9500 0x7f6f541546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f52d9d640 1 -- 172.21.15.42:0/2149397002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f541e8df0 con 0x7f6f540caf80 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.145+0000 7f6f5259c640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f540b7ba0 0x7f6f54151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.146+0000 7f6f52d9d640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f5414fc90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097a0 tx=0x7f6f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.146+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44037050 con 0x7f6f540caf80 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.146+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44038040 con 0x7f6f540caf80 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.146+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44004490 con 0x7f6f540caf80 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.146+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f541f31a0 con 0x7f6f540caf80 2024-05-09T01:45:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.146+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f541f3760 con 0x7f6f540caf80 2024-05-09T01:45:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.147+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f540cbf50 con 0x7f6f540caf80 2024-05-09T01:45:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.148+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6f44030980 con 0x7f6f540caf80 2024-05-09T01:45:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.148+0000 7f6f4affd640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6f340762d0 0x7f6f340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.148+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6f440b8010 con 0x7f6f540caf80 2024-05-09T01:45:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.148+0000 7f6f5259c640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6f340762d0 0x7f6f340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.149+0000 7f6f5259c640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6f340762d0 0x7f6f340787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0012e0 tx=0x7f6f4c005c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.153+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6f44081860 con 0x7f6f540caf80 2024-05-09T01:45:22.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.341+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f54153a90 con 0x7f6f340762d0 2024-05-09T01:45:22.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.348+0000 7f6f4affd640 1 -- 172.21.15.42:0/2149397002 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250097 (secure 0 0 0) 0x7f6f54153a90 con 0x7f6f340762d0 2024-05-09T01:45:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:22.349 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:45:22.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6f340762d0 msgr2=0x7f6f340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6f340762d0 0x7f6f340787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0012e0 tx=0x7f6f4c005c30 comp rx=0 tx=0).stop 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 msgr2=0x7f6f5414fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f5414fc90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097a0 tx=0x7f6f440046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 shutdown_connections 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f6f340762d0 0x7f6f340787e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f540caf80 0x7f6f5414fc90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f540c9500 0x7f6f541546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 --2- 172.21.15.42:0/2149397002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f540b7ba0 0x7f6f54151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 >> 172.21.15.42:0/2149397002 conn(0x7f6f540d2100 msgr2=0x7f6f540c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 shutdown_connections 2024-05-09T01:45:22.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:22.351+0000 7f6f58e69640 1 -- 172.21.15.42:0/2149397002 wait complete. 2024-05-09T01:45:22.360 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-05-09T01:45:22.281528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":800831,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9664,"num_write_kb":25167770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10132,"ondisk_log_size":10132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290488,"kb_used_data":3640,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754684232,"statfs":{"total":773094113280,"available":772796653568,"internally_reserved":0,"allocated":3727360,"data_stored":2286758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737399922,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2586,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002931"},"pg_stats":[{"pgid":"3.3f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.826238+0000","last_change":"2024-05-09T01:41:41.348265+0000","last_active":"2024-05-09T01:45:16.826238+0000","last_peered":"2024-05-09T01:45:16.826238+0000","last_clean":"2024-05-09T01:45:16.826238+0000","last_became_active":"2024-05-09T01:41:41.347858+0000","last_became_peered":"2024-05-09T01:41:41.347858+0000","last_unstale":"2024-05-09T01:45:16.826238+0000","last_undegraded":"2024-05-09T01:45:16.826238+0000","last_fullsized":"2024-05-09T01:45:16.826238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"23'130","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.863457+0000","last_change":"2024-05-09T01:40:59.755023+0000","last_active":"2024-05-09T01:45:16.863457+0000","last_peered":"2024-05-09T01:45:16.863457+0000","last_clean":"2024-05-09T01:45:16.863457+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:45:16.863457+0000","last_undegraded":"2024-05-09T01:45:16.863457+0000","last_fullsized":"2024-05-09T01:45:16.863457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'151","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.777426+0000","last_change":"2024-05-09T01:40:59.760667+0000","last_active":"2024-05-09T01:45:16.777426+0000","last_peered":"2024-05-09T01:45:16.777426+0000","last_clean":"2024-05-09T01:45:16.777426+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:45:16.777426+0000","last_undegraded":"2024-05-09T01:45:16.777426+0000","last_fullsized":"2024-05-09T01:45:16.777426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'173","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.868589+0000","last_change":"2024-05-09T01:40:59.758554+0000","last_active":"2024-05-09T01:45:16.868589+0000","last_peered":"2024-05-09T01:45:16.868589+0000","last_clean":"2024-05-09T01:45:16.868589+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:45:16.868589+0000","last_undegraded":"2024-05-09T01:45:16.868589+0000","last_fullsized":"2024-05-09T01:45:16.868589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'148","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.841907+0000","last_change":"2024-05-09T01:40:59.761336+0000","last_active":"2024-05-09T01:45:16.841907+0000","last_peered":"2024-05-09T01:45:16.841907+0000","last_clean":"2024-05-09T01:45:16.841907+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:45:16.841907+0000","last_undegraded":"2024-05-09T01:45:16.841907+0000","last_fullsized":"2024-05-09T01:45:16.841907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'135","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.839621+0000","last_change":"2024-05-09T01:40:59.762874+0000","last_active":"2024-05-09T01:45:16.839621+0000","last_peered":"2024-05-09T01:45:16.839621+0000","last_clean":"2024-05-09T01:45:16.839621+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:45:16.839621+0000","last_undegraded":"2024-05-09T01:45:16.839621+0000","last_fullsized":"2024-05-09T01:45:16.839621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'164","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.818329+0000","last_change":"2024-05-09T01:40:59.764250+0000","last_active":"2024-05-09T01:45:16.818329+0000","last_peered":"2024-05-09T01:45:16.818329+0000","last_clean":"2024-05-09T01:45:16.818329+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:45:16.818329+0000","last_undegraded":"2024-05-09T01:45:16.818329+0000","last_fullsized":"2024-05-09T01:45:16.818329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'186","reported_seq":204,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.872843+0000","last_change":"2024-05-09T01:40:59.747894+0000","last_active":"2024-05-09T01:45:16.872843+0000","last_peered":"2024-05-09T01:45:16.872843+0000","last_clean":"2024-05-09T01:45:16.872843+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:45:16.872843+0000","last_undegraded":"2024-05-09T01:45:16.872843+0000","last_fullsized":"2024-05-09T01:45:16.872843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'152","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.863032+0000","last_change":"2024-05-09T01:40:59.766496+0000","last_active":"2024-05-09T01:45:16.863032+0000","last_peered":"2024-05-09T01:45:16.863032+0000","last_clean":"2024-05-09T01:45:16.863032+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:45:16.863032+0000","last_undegraded":"2024-05-09T01:45:16.863032+0000","last_fullsized":"2024-05-09T01:45:16.863032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'156","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.868874+0000","last_change":"2024-05-09T01:40:59.753745+0000","last_active":"2024-05-09T01:45:16.868874+0000","last_peered":"2024-05-09T01:45:16.868874+0000","last_clean":"2024-05-09T01:45:16.868874+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:45:16.868874+0000","last_undegraded":"2024-05-09T01:45:16.868874+0000","last_fullsized":"2024-05-09T01:45:16.868874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.846941+0000","last_change":"2024-05-09T01:41:41.345044+0000","last_active":"2024-05-09T01:45:16.846941+0000","last_peered":"2024-05-09T01:45:16.846941+0000","last_clean":"2024-05-09T01:45:16.846941+0000","last_became_active":"2024-05-09T01:41:41.344652+0000","last_became_peered":"2024-05-09T01:41:41.344652+0000","last_unstale":"2024-05-09T01:45:16.846941+0000","last_undegraded":"2024-05-09T01:45:16.846941+0000","last_fullsized":"2024-05-09T01:45:16.846941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'142","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.812314+0000","last_change":"2024-05-09T01:40:59.756423+0000","last_active":"2024-05-09T01:45:16.812314+0000","last_peered":"2024-05-09T01:45:16.812314+0000","last_clean":"2024-05-09T01:45:16.812314+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:45:16.812314+0000","last_undegraded":"2024-05-09T01:45:16.812314+0000","last_fullsized":"2024-05-09T01:45:16.812314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:24.495307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'151","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.853452+0000","last_change":"2024-05-09T01:40:59.749235+0000","last_active":"2024-05-09T01:45:16.853452+0000","last_peered":"2024-05-09T01:45:16.853452+0000","last_clean":"2024-05-09T01:45:16.853452+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:45:16.853452+0000","last_undegraded":"2024-05-09T01:45:16.853452+0000","last_fullsized":"2024-05-09T01:45:16.853452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'149","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.863217+0000","last_change":"2024-05-09T01:40:59.759243+0000","last_active":"2024-05-09T01:45:16.863217+0000","last_peered":"2024-05-09T01:45:16.863217+0000","last_clean":"2024-05-09T01:45:16.863217+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:45:16.863217+0000","last_undegraded":"2024-05-09T01:45:16.863217+0000","last_fullsized":"2024-05-09T01:45:16.863217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'151","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.856227+0000","last_change":"2024-05-09T01:40:59.747760+0000","last_active":"2024-05-09T01:45:16.856227+0000","last_peered":"2024-05-09T01:45:16.856227+0000","last_clean":"2024-05-09T01:45:16.856227+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:45:16.856227+0000","last_undegraded":"2024-05-09T01:45:16.856227+0000","last_fullsized":"2024-05-09T01:45:16.856227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'147","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.780453+0000","last_change":"2024-05-09T01:40:59.763276+0000","last_active":"2024-05-09T01:45:16.780453+0000","last_peered":"2024-05-09T01:45:16.780453+0000","last_clean":"2024-05-09T01:45:16.780453+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:45:16.780453+0000","last_undegraded":"2024-05-09T01:45:16.780453+0000","last_fullsized":"2024-05-09T01:45:16.780453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'146","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.871613+0000","last_change":"2024-05-09T01:40:59.763824+0000","last_active":"2024-05-09T01:45:16.871613+0000","last_peered":"2024-05-09T01:45:16.871613+0000","last_clean":"2024-05-09T01:45:16.871613+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:45:16.871613+0000","last_undegraded":"2024-05-09T01:45:16.871613+0000","last_fullsized":"2024-05-09T01:45:16.871613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'157","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.871685+0000","last_change":"2024-05-09T01:40:59.752916+0000","last_active":"2024-05-09T01:45:16.871685+0000","last_peered":"2024-05-09T01:45:16.871685+0000","last_clean":"2024-05-09T01:45:16.871685+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:45:16.871685+0000","last_undegraded":"2024-05-09T01:45:16.871685+0000","last_fullsized":"2024-05-09T01:45:16.871685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'172","reported_seq":190,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.854505+0000","last_change":"2024-05-09T01:40:59.763917+0000","last_active":"2024-05-09T01:45:16.854505+0000","last_peered":"2024-05-09T01:45:16.854505+0000","last_clean":"2024-05-09T01:45:16.854505+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:45:16.854505+0000","last_undegraded":"2024-05-09T01:45:16.854505+0000","last_fullsized":"2024-05-09T01:45:16.854505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'161","reported_seq":179,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.838412+0000","last_change":"2024-05-09T01:40:59.753721+0000","last_active":"2024-05-09T01:45:16.838412+0000","last_peered":"2024-05-09T01:45:16.838412+0000","last_clean":"2024-05-09T01:45:16.838412+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:45:16.838412+0000","last_undegraded":"2024-05-09T01:45:16.838412+0000","last_fullsized":"2024-05-09T01:45:16.838412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'137","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.865885+0000","last_change":"2024-05-09T01:40:59.760722+0000","last_active":"2024-05-09T01:45:16.865885+0000","last_peered":"2024-05-09T01:45:16.865885+0000","last_clean":"2024-05-09T01:45:16.865885+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:45:16.865885+0000","last_undegraded":"2024-05-09T01:45:16.865885+0000","last_fullsized":"2024-05-09T01:45:16.865885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'166","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.868435+0000","last_change":"2024-05-09T01:40:59.761439+0000","last_active":"2024-05-09T01:45:16.868435+0000","last_peered":"2024-05-09T01:45:16.868435+0000","last_clean":"2024-05-09T01:45:16.868435+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:45:16.868435+0000","last_undegraded":"2024-05-09T01:45:16.868435+0000","last_fullsized":"2024-05-09T01:45:16.868435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'134","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.760246+0000","last_change":"2024-05-09T01:40:59.755650+0000","last_active":"2024-05-09T01:45:16.760246+0000","last_peered":"2024-05-09T01:45:16.760246+0000","last_clean":"2024-05-09T01:45:16.760246+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:45:16.760246+0000","last_undegraded":"2024-05-09T01:45:16.760246+0000","last_fullsized":"2024-05-09T01:45:16.760246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'180","reported_seq":199,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.020331+0000","last_change":"2024-05-09T01:40:59.748702+0000","last_active":"2024-05-09T01:45:21.020331+0000","last_peered":"2024-05-09T01:45:21.020331+0000","last_clean":"2024-05-09T01:45:21.020331+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:45:21.020331+0000","last_undegraded":"2024-05-09T01:45:21.020331+0000","last_fullsized":"2024-05-09T01:45:21.020331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'134","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.023116+0000","last_change":"2024-05-09T01:40:59.757003+0000","last_active":"2024-05-09T01:45:20.023116+0000","last_peered":"2024-05-09T01:45:20.023116+0000","last_clean":"2024-05-09T01:45:20.023116+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:45:20.023116+0000","last_undegraded":"2024-05-09T01:45:20.023116+0000","last_fullsized":"2024-05-09T01:45:20.023116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'198","reported_seq":217,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.514976+0000","last_change":"2024-05-09T01:40:59.761173+0000","last_active":"2024-05-09T01:45:21.514976+0000","last_peered":"2024-05-09T01:45:21.514976+0000","last_clean":"2024-05-09T01:45:21.514976+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:45:21.514976+0000","last_undegraded":"2024-05-09T01:45:21.514976+0000","last_fullsized":"2024-05-09T01:45:21.514976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'144","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.027242+0000","last_change":"2024-05-09T01:40:59.749779+0000","last_active":"2024-05-09T01:45:19.027242+0000","last_peered":"2024-05-09T01:45:19.027242+0000","last_clean":"2024-05-09T01:45:19.027242+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:45:19.027242+0000","last_undegraded":"2024-05-09T01:45:19.027242+0000","last_fullsized":"2024-05-09T01:45:19.027242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'133","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.023018+0000","last_change":"2024-05-09T01:40:59.754757+0000","last_active":"2024-05-09T01:45:20.023018+0000","last_peered":"2024-05-09T01:45:20.023018+0000","last_clean":"2024-05-09T01:45:20.023018+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:45:20.023018+0000","last_undegraded":"2024-05-09T01:45:20.023018+0000","last_fullsized":"2024-05-09T01:45:20.023018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'118","reported_seq":137,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.834998+0000","last_change":"2024-05-09T01:40:59.761662+0000","last_active":"2024-05-09T01:45:16.834998+0000","last_peered":"2024-05-09T01:45:16.834998+0000","last_clean":"2024-05-09T01:45:16.834998+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:45:16.834998+0000","last_undegraded":"2024-05-09T01:45:16.834998+0000","last_fullsized":"2024-05-09T01:45:16.834998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'131","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.838089+0000","last_change":"2024-05-09T01:40:59.748727+0000","last_active":"2024-05-09T01:45:16.838089+0000","last_peered":"2024-05-09T01:45:16.838089+0000","last_clean":"2024-05-09T01:45:16.838089+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:45:16.838089+0000","last_undegraded":"2024-05-09T01:45:16.838089+0000","last_fullsized":"2024-05-09T01:45:16.838089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'135","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.865678+0000","last_change":"2024-05-09T01:41:41.644145+0000","last_active":"2024-05-09T01:45:16.865678+0000","last_peered":"2024-05-09T01:45:16.865678+0000","last_clean":"2024-05-09T01:45:16.865678+0000","last_became_active":"2024-05-09T01:41:41.643556+0000","last_became_peered":"2024-05-09T01:41:41.643556+0000","last_unstale":"2024-05-09T01:45:16.865678+0000","last_undegraded":"2024-05-09T01:45:16.865678+0000","last_fullsized":"2024-05-09T01:45:16.865678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'150","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:17.733768+0000","last_change":"2024-05-09T01:40:59.762437+0000","last_active":"2024-05-09T01:45:17.733768+0000","last_peered":"2024-05-09T01:45:17.733768+0000","last_clean":"2024-05-09T01:45:17.733768+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:45:17.733768+0000","last_undegraded":"2024-05-09T01:45:17.733768+0000","last_fullsized":"2024-05-09T01:45:17.733768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'130","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.710093+0000","last_change":"2024-05-09T01:40:59.754119+0000","last_active":"2024-05-09T01:45:16.710093+0000","last_peered":"2024-05-09T01:45:16.710093+0000","last_clean":"2024-05-09T01:45:16.710093+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:45:16.710093+0000","last_undegraded":"2024-05-09T01:45:16.710093+0000","last_fullsized":"2024-05-09T01:45:16.710093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:22:51.574034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'8","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.462132+0000","last_change":"2024-05-09T01:45:20.462189+0000","last_active":"2024-05-09T01:45:20.462132+0000","last_peered":"2024-05-09T01:45:20.462132+0000","last_clean":"2024-05-09T01:45:20.462132+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:45:20.462132+0000","last_undegraded":"2024-05-09T01:45:20.462132+0000","last_fullsized":"2024-05-09T01:45:20.462132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-09T01:45:20.462034+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-09T01:45:20.462034+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.462034+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:05.006755+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'137","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.860784+0000","last_change":"2024-05-09T01:40:59.758663+0000","last_active":"2024-05-09T01:45:16.860784+0000","last_peered":"2024-05-09T01:45:16.860784+0000","last_clean":"2024-05-09T01:45:16.860784+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:45:16.860784+0000","last_undegraded":"2024-05-09T01:45:16.860784+0000","last_fullsized":"2024-05-09T01:45:16.860784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:32.240524+0000","last_change":"2024-05-09T01:40:58.749090+0000","last_active":"2024-05-09T01:43:32.240524+0000","last_peered":"2024-05-09T01:43:32.240524+0000","last_clean":"2024-05-09T01:43:32.240524+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:43:32.240524+0000","last_undegraded":"2024-05-09T01:43:32.240524+0000","last_fullsized":"2024-05-09T01:43:32.240524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:26.239649+0000","last_change":"2024-05-09T01:40:58.754141+0000","last_active":"2024-05-09T01:43:26.239649+0000","last_peered":"2024-05-09T01:43:26.239649+0000","last_clean":"2024-05-09T01:43:26.239649+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:43:26.239649+0000","last_undegraded":"2024-05-09T01:43:26.239649+0000","last_fullsized":"2024-05-09T01:43:26.239649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'170","reported_seq":188,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.804335+0000","last_change":"2024-05-09T01:40:59.763553+0000","last_active":"2024-05-09T01:45:16.804335+0000","last_peered":"2024-05-09T01:45:16.804335+0000","last_clean":"2024-05-09T01:45:16.804335+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:45:16.804335+0000","last_undegraded":"2024-05-09T01:45:16.804335+0000","last_fullsized":"2024-05-09T01:45:16.804335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:27.240022+0000","last_change":"2024-05-09T01:40:58.751986+0000","last_active":"2024-05-09T01:43:27.240022+0000","last_peered":"2024-05-09T01:43:27.240022+0000","last_clean":"2024-05-09T01:43:27.240022+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:43:27.240022+0000","last_undegraded":"2024-05-09T01:43:27.240022+0000","last_fullsized":"2024-05-09T01:43:27.240022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'157","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.806947+0000","last_change":"2024-05-09T01:40:59.746994+0000","last_active":"2024-05-09T01:45:16.806947+0000","last_peered":"2024-05-09T01:45:16.806947+0000","last_clean":"2024-05-09T01:45:16.806947+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:45:16.806947+0000","last_undegraded":"2024-05-09T01:45:16.806947+0000","last_fullsized":"2024-05-09T01:45:16.806947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'9","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:14.673380+0000","last_change":"2024-05-09T01:40:58.752338+0000","last_active":"2024-05-09T01:45:14.673380+0000","last_peered":"2024-05-09T01:45:14.673380+0000","last_clean":"2024-05-09T01:45:14.673380+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:45:14.673380+0000","last_undegraded":"2024-05-09T01:45:14.673380+0000","last_fullsized":"2024-05-09T01:45:14.673380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'229","reported_seq":247,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.874460+0000","last_change":"2024-05-09T01:40:59.762205+0000","last_active":"2024-05-09T01:45:16.874460+0000","last_peered":"2024-05-09T01:45:16.874460+0000","last_clean":"2024-05-09T01:45:16.874460+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:45:16.874460+0000","last_undegraded":"2024-05-09T01:45:16.874460+0000","last_fullsized":"2024-05-09T01:45:16.874460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:27.240108+0000","last_change":"2024-05-09T01:40:58.755454+0000","last_active":"2024-05-09T01:43:27.240108+0000","last_peered":"2024-05-09T01:43:27.240108+0000","last_clean":"2024-05-09T01:43:27.240108+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:43:27.240108+0000","last_undegraded":"2024-05-09T01:43:27.240108+0000","last_fullsized":"2024-05-09T01:43:27.240108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'141","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.866023+0000","last_change":"2024-05-09T01:40:59.755713+0000","last_active":"2024-05-09T01:45:16.866023+0000","last_peered":"2024-05-09T01:45:16.866023+0000","last_clean":"2024-05-09T01:45:16.866023+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:45:16.866023+0000","last_undegraded":"2024-05-09T01:45:16.866023+0000","last_fullsized":"2024-05-09T01:45:16.866023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'10","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:17.737138+0000","last_change":"2024-05-09T01:40:58.756601+0000","last_active":"2024-05-09T01:45:17.737138+0000","last_peered":"2024-05-09T01:45:17.737138+0000","last_clean":"2024-05-09T01:45:17.737138+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:45:17.737138+0000","last_undegraded":"2024-05-09T01:45:17.737138+0000","last_fullsized":"2024-05-09T01:45:17.737138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'149","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.791929+0000","last_change":"2024-05-09T01:40:59.761836+0000","last_active":"2024-05-09T01:45:16.791929+0000","last_peered":"2024-05-09T01:45:16.791929+0000","last_clean":"2024-05-09T01:45:16.791929+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:45:16.791929+0000","last_undegraded":"2024-05-09T01:45:16.791929+0000","last_fullsized":"2024-05-09T01:45:16.791929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:09.044291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'96","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.786733+0000","last_change":"2024-05-09T01:40:58.752247+0000","last_active":"2024-05-09T01:45:19.786733+0000","last_peered":"2024-05-09T01:45:19.786733+0000","last_clean":"2024-05-09T01:45:19.786733+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:45:19.786733+0000","last_undegraded":"2024-05-09T01:45:19.786733+0000","last_fullsized":"2024-05-09T01:45:19.786733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'150","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.765719+0000","last_change":"2024-05-09T01:40:59.762805+0000","last_active":"2024-05-09T01:45:16.765719+0000","last_peered":"2024-05-09T01:45:16.765719+0000","last_clean":"2024-05-09T01:45:16.765719+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:45:16.765719+0000","last_undegraded":"2024-05-09T01:45:16.765719+0000","last_fullsized":"2024-05-09T01:45:16.765719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.590953+0000","last_change":"2024-05-09T01:45:19.591021+0000","last_active":"2024-05-09T01:45:19.590953+0000","last_peered":"2024-05-09T01:45:19.590953+0000","last_clean":"2024-05-09T01:45:19.590953+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:45:19.590953+0000","last_undegraded":"2024-05-09T01:45:19.590953+0000","last_fullsized":"2024-05-09T01:45:19.590953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-05-09T01:45:19.590807+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-05-09T01:45:19.590807+0000","last_clean_scrub_stamp":"2024-05-09T01:45:19.590807+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:59.045182+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'157","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.851196+0000","last_change":"2024-05-09T01:40:59.761269+0000","last_active":"2024-05-09T01:45:16.851196+0000","last_peered":"2024-05-09T01:45:16.851196+0000","last_clean":"2024-05-09T01:45:16.851196+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:45:16.851196+0000","last_undegraded":"2024-05-09T01:45:16.851196+0000","last_fullsized":"2024-05-09T01:45:16.851196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:22.239490+0000","last_change":"2024-05-09T01:40:58.754918+0000","last_active":"2024-05-09T01:43:22.239490+0000","last_peered":"2024-05-09T01:43:22.239490+0000","last_clean":"2024-05-09T01:43:22.239490+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:43:22.239490+0000","last_undegraded":"2024-05-09T01:43:22.239490+0000","last_fullsized":"2024-05-09T01:43:22.239490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'171","reported_seq":189,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.842272+0000","last_change":"2024-05-09T01:40:59.766171+0000","last_active":"2024-05-09T01:45:16.842272+0000","last_peered":"2024-05-09T01:45:16.842272+0000","last_clean":"2024-05-09T01:45:16.842272+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:45:16.842272+0000","last_undegraded":"2024-05-09T01:45:16.842272+0000","last_fullsized":"2024-05-09T01:45:16.842272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'7","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:14.651068+0000","last_change":"2024-05-09T01:40:58.750699+0000","last_active":"2024-05-09T01:45:14.651068+0000","last_peered":"2024-05-09T01:45:14.651068+0000","last_clean":"2024-05-09T01:45:14.651068+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:45:14.651068+0000","last_undegraded":"2024-05-09T01:45:14.651068+0000","last_fullsized":"2024-05-09T01:45:14.651068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'165","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.870378+0000","last_change":"2024-05-09T01:40:59.750156+0000","last_active":"2024-05-09T01:45:16.870378+0000","last_peered":"2024-05-09T01:45:16.870378+0000","last_clean":"2024-05-09T01:45:16.870378+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:45:16.870378+0000","last_undegraded":"2024-05-09T01:45:16.870378+0000","last_fullsized":"2024-05-09T01:45:16.870378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'26","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.895916+0000","last_change":"2024-05-09T01:45:19.895965+0000","last_active":"2024-05-09T01:45:19.895916+0000","last_peered":"2024-05-09T01:45:19.895916+0000","last_clean":"2024-05-09T01:45:19.895916+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:45:19.895916+0000","last_undegraded":"2024-05-09T01:45:19.895916+0000","last_fullsized":"2024-05-09T01:45:19.895916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'26","last_scrub_stamp":"2024-05-09T01:45:19.895835+0000","last_deep_scrub":"23'26","last_deep_scrub_stamp":"2024-05-09T01:45:19.895835+0000","last_clean_scrub_stamp":"2024-05-09T01:45:19.895835+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:22.340657+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'189","reported_seq":207,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.858329+0000","last_change":"2024-05-09T01:40:59.764812+0000","last_active":"2024-05-09T01:45:16.858329+0000","last_peered":"2024-05-09T01:45:16.858329+0000","last_clean":"2024-05-09T01:45:16.858329+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:45:16.858329+0000","last_undegraded":"2024-05-09T01:45:16.858329+0000","last_fullsized":"2024-05-09T01:45:16.858329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:41:41.344769+0000","last_change":"2024-05-09T01:40:58.752491+0000","last_active":"2024-05-09T01:41:41.344769+0000","last_peered":"2024-05-09T01:41:41.344769+0000","last_clean":"2024-05-09T01:41:41.344769+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:41:41.344769+0000","last_undegraded":"2024-05-09T01:41:41.344769+0000","last_fullsized":"2024-05-09T01:41:41.344769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:35.219361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'146","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.841139+0000","last_change":"2024-05-09T01:40:59.764346+0000","last_active":"2024-05-09T01:45:16.841139+0000","last_peered":"2024-05-09T01:45:16.841139+0000","last_clean":"2024-05-09T01:45:16.841139+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:45:16.841139+0000","last_undegraded":"2024-05-09T01:45:16.841139+0000","last_fullsized":"2024-05-09T01:45:16.841139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:16.238154+0000","last_change":"2024-05-09T01:40:58.753749+0000","last_active":"2024-05-09T01:43:16.238154+0000","last_peered":"2024-05-09T01:43:16.238154+0000","last_clean":"2024-05-09T01:43:16.238154+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:43:16.238154+0000","last_undegraded":"2024-05-09T01:43:16.238154+0000","last_fullsized":"2024-05-09T01:43:16.238154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'138","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.816447+0000","last_change":"2024-05-09T01:40:59.766180+0000","last_active":"2024-05-09T01:45:16.816447+0000","last_peered":"2024-05-09T01:45:16.816447+0000","last_clean":"2024-05-09T01:45:16.816447+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:45:16.816447+0000","last_undegraded":"2024-05-09T01:45:16.816447+0000","last_fullsized":"2024-05-09T01:45:16.816447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.631254+0000","last_change":"2024-05-09T01:45:20.631317+0000","last_active":"2024-05-09T01:45:20.631254+0000","last_peered":"2024-05-09T01:45:20.631254+0000","last_clean":"2024-05-09T01:45:20.631254+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:45:20.631254+0000","last_undegraded":"2024-05-09T01:45:20.631254+0000","last_fullsized":"2024-05-09T01:45:20.631254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-09T01:45:20.631152+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-09T01:45:20.631152+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.631152+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:13.734471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'144","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.836026+0000","last_change":"2024-05-09T01:40:59.752319+0000","last_active":"2024-05-09T01:45:16.836026+0000","last_peered":"2024-05-09T01:45:16.836026+0000","last_clean":"2024-05-09T01:45:16.836026+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:45:16.836026+0000","last_undegraded":"2024-05-09T01:45:16.836026+0000","last_fullsized":"2024-05-09T01:45:16.836026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'9","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.852142+0000","last_change":"2024-05-09T01:45:20.852171+0000","last_active":"2024-05-09T01:45:20.852142+0000","last_peered":"2024-05-09T01:45:20.852142+0000","last_clean":"2024-05-09T01:45:20.852142+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:45:20.852142+0000","last_undegraded":"2024-05-09T01:45:20.852142+0000","last_fullsized":"2024-05-09T01:45:20.852142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-09T01:45:20.852052+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-09T01:45:20.852052+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.852052+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:48.687974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'151","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.808042+0000","last_change":"2024-05-09T01:40:59.766419+0000","last_active":"2024-05-09T01:45:16.808042+0000","last_peered":"2024-05-09T01:45:16.808042+0000","last_clean":"2024-05-09T01:45:16.808042+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:45:16.808042+0000","last_undegraded":"2024-05-09T01:45:16.808042+0000","last_fullsized":"2024-05-09T01:45:16.808042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:44:47.261739+0000","last_change":"2024-05-09T01:40:48.166904+0000","last_active":"2024-05-09T01:44:47.261739+0000","last_peered":"2024-05-09T01:44:47.261739+0000","last_clean":"2024-05-09T01:44:47.261739+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:44:47.261739+0000","last_undegraded":"2024-05-09T01:44:47.261739+0000","last_fullsized":"2024-05-09T01:44:47.261739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:46.917312+0000","last_clean_scrub_stamp":"2024-05-09T01:40:46.917312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'11","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.114324+0000","last_change":"2024-05-09T01:45:22.114371+0000","last_active":"2024-05-09T01:45:22.114324+0000","last_peered":"2024-05-09T01:45:22.114324+0000","last_clean":"2024-05-09T01:45:22.114324+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:45:22.114324+0000","last_undegraded":"2024-05-09T01:45:22.114324+0000","last_fullsized":"2024-05-09T01:45:22.114324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-09T01:45:22.114221+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-09T01:45:22.114221+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.114221+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:16.007075+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'158","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.869987+0000","last_change":"2024-05-09T01:41:41.345428+0000","last_active":"2024-05-09T01:45:16.869987+0000","last_peered":"2024-05-09T01:45:16.869987+0000","last_clean":"2024-05-09T01:45:16.869987+0000","last_became_active":"2024-05-09T01:41:41.345116+0000","last_became_peered":"2024-05-09T01:41:41.345116+0000","last_unstale":"2024-05-09T01:45:16.869987+0000","last_undegraded":"2024-05-09T01:45:16.869987+0000","last_fullsized":"2024-05-09T01:45:16.869987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:02.263475+0000","last_change":"2024-05-09T01:40:58.753718+0000","last_active":"2024-05-09T01:45:02.263475+0000","last_peered":"2024-05-09T01:45:02.263475+0000","last_clean":"2024-05-09T01:45:02.263475+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:45:02.263475+0000","last_undegraded":"2024-05-09T01:45:02.263475+0000","last_fullsized":"2024-05-09T01:45:02.263475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.570470+0000","last_change":"2024-05-09T01:45:20.570526+0000","last_active":"2024-05-09T01:45:20.570470+0000","last_peered":"2024-05-09T01:45:20.570470+0000","last_clean":"2024-05-09T01:45:20.570470+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:45:20.570470+0000","last_undegraded":"2024-05-09T01:45:20.570470+0000","last_fullsized":"2024-05-09T01:45:20.570470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-05-09T01:45:20.570365+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-05-09T01:45:20.570365+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.570365+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:50.318844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'12","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:15.049272+0000","last_change":"2024-05-09T01:40:58.754082+0000","last_active":"2024-05-09T01:45:15.049272+0000","last_peered":"2024-05-09T01:45:15.049272+0000","last_clean":"2024-05-09T01:45:15.049272+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:45:15.049272+0000","last_undegraded":"2024-05-09T01:45:15.049272+0000","last_fullsized":"2024-05-09T01:45:15.049272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'131","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.843854+0000","last_change":"2024-05-09T01:40:59.745997+0000","last_active":"2024-05-09T01:45:16.843854+0000","last_peered":"2024-05-09T01:45:16.843854+0000","last_clean":"2024-05-09T01:45:16.843854+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:45:16.843854+0000","last_undegraded":"2024-05-09T01:45:16.843854+0000","last_fullsized":"2024-05-09T01:45:16.843854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:12.257465+0000","last_change":"2024-05-09T01:40:58.752497+0000","last_active":"2024-05-09T01:45:12.257465+0000","last_peered":"2024-05-09T01:45:12.257465+0000","last_clean":"2024-05-09T01:45:12.257465+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:45:12.257465+0000","last_undegraded":"2024-05-09T01:45:12.257465+0000","last_fullsized":"2024-05-09T01:45:12.257465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'146","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.794507+0000","last_change":"2024-05-09T01:40:59.762926+0000","last_active":"2024-05-09T01:45:16.794507+0000","last_peered":"2024-05-09T01:45:16.794507+0000","last_clean":"2024-05-09T01:45:16.794507+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:45:16.794507+0000","last_undegraded":"2024-05-09T01:45:16.794507+0000","last_fullsized":"2024-05-09T01:45:16.794507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:24.579385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:11.252175+0000","last_change":"2024-05-09T01:40:58.754811+0000","last_active":"2024-05-09T01:45:11.252175+0000","last_peered":"2024-05-09T01:45:11.252175+0000","last_clean":"2024-05-09T01:45:11.252175+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:45:11.252175+0000","last_undegraded":"2024-05-09T01:45:11.252175+0000","last_fullsized":"2024-05-09T01:45:11.252175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'143","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.852960+0000","last_change":"2024-05-09T01:40:59.757232+0000","last_active":"2024-05-09T01:45:16.852960+0000","last_peered":"2024-05-09T01:45:16.852960+0000","last_clean":"2024-05-09T01:45:16.852960+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:45:16.852960+0000","last_undegraded":"2024-05-09T01:45:16.852960+0000","last_fullsized":"2024-05-09T01:45:16.852960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:12.264689+0000","last_change":"2024-05-09T01:40:58.754939+0000","last_active":"2024-05-09T01:45:12.264689+0000","last_peered":"2024-05-09T01:45:12.264689+0000","last_clean":"2024-05-09T01:45:12.264689+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:45:12.264689+0000","last_undegraded":"2024-05-09T01:45:12.264689+0000","last_fullsized":"2024-05-09T01:45:12.264689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'144","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.850156+0000","last_change":"2024-05-09T01:40:59.747992+0000","last_active":"2024-05-09T01:45:16.850156+0000","last_peered":"2024-05-09T01:45:16.850156+0000","last_clean":"2024-05-09T01:45:16.850156+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:45:16.850156+0000","last_undegraded":"2024-05-09T01:45:16.850156+0000","last_fullsized":"2024-05-09T01:45:16.850156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'24","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.027071+0000","last_change":"2024-05-09T01:40:58.757039+0000","last_active":"2024-05-09T01:45:19.027071+0000","last_peered":"2024-05-09T01:45:19.027071+0000","last_clean":"2024-05-09T01:45:19.027071+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:45:19.027071+0000","last_undegraded":"2024-05-09T01:45:19.027071+0000","last_fullsized":"2024-05-09T01:45:19.027071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'143","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.023021+0000","last_change":"2024-05-09T01:40:59.763912+0000","last_active":"2024-05-09T01:45:20.023021+0000","last_peered":"2024-05-09T01:45:20.023021+0000","last_clean":"2024-05-09T01:45:20.023021+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:45:20.023021+0000","last_undegraded":"2024-05-09T01:45:20.023021+0000","last_fullsized":"2024-05-09T01:45:20.023021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'8","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.514860+0000","last_change":"2024-05-09T01:40:58.751426+0000","last_active":"2024-05-09T01:45:21.514860+0000","last_peered":"2024-05-09T01:45:21.514860+0000","last_clean":"2024-05-09T01:45:21.514860+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:45:21.514860+0000","last_undegraded":"2024-05-09T01:45:21.514860+0000","last_fullsized":"2024-05-09T01:45:21.514860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'163","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:18.534216+0000","last_change":"2024-05-09T01:40:59.759293+0000","last_active":"2024-05-09T01:45:18.534216+0000","last_peered":"2024-05-09T01:45:18.534216+0000","last_clean":"2024-05-09T01:45:18.534216+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:45:18.534216+0000","last_undegraded":"2024-05-09T01:45:18.534216+0000","last_fullsized":"2024-05-09T01:45:18.534216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.010198+0000","last_change":"2024-05-09T01:40:58.754954+0000","last_active":"2024-05-09T01:45:22.010198+0000","last_peered":"2024-05-09T01:45:22.010198+0000","last_clean":"2024-05-09T01:45:22.010198+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:45:22.010198+0000","last_undegraded":"2024-05-09T01:45:22.010198+0000","last_fullsized":"2024-05-09T01:45:22.010198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'134","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.846640+0000","last_change":"2024-05-09T01:40:59.750465+0000","last_active":"2024-05-09T01:45:16.846640+0000","last_peered":"2024-05-09T01:45:16.846640+0000","last_clean":"2024-05-09T01:45:16.846640+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:45:16.846640+0000","last_undegraded":"2024-05-09T01:45:16.846640+0000","last_fullsized":"2024-05-09T01:45:16.846640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:43.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'11","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.669040+0000","last_change":"2024-05-09T01:45:19.669040+0000","last_active":"2024-05-09T01:45:19.669040+0000","last_peered":"2024-05-09T01:45:19.669040+0000","last_clean":"2024-05-09T01:45:19.669040+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:45:19.669040+0000","last_undegraded":"2024-05-09T01:45:19.669040+0000","last_fullsized":"2024-05-09T01:45:19.669040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-09T01:45:19.668850+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-09T01:45:19.668850+0000","last_clean_scrub_stamp":"2024-05-09T01:45:19.668850+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:51.597170+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'153","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.023014+0000","last_change":"2024-05-09T01:40:59.751453+0000","last_active":"2024-05-09T01:45:20.023014+0000","last_peered":"2024-05-09T01:45:20.023014+0000","last_clean":"2024-05-09T01:45:20.023014+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:45:20.023014+0000","last_undegraded":"2024-05-09T01:45:20.023014+0000","last_fullsized":"2024-05-09T01:45:20.023014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.027105+0000","last_change":"2024-05-09T01:40:58.756976+0000","last_active":"2024-05-09T01:45:19.027105+0000","last_peered":"2024-05-09T01:45:19.027105+0000","last_clean":"2024-05-09T01:45:19.027105+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:45:19.027105+0000","last_undegraded":"2024-05-09T01:45:19.027105+0000","last_fullsized":"2024-05-09T01:45:19.027105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'143","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.805610+0000","last_change":"2024-05-09T01:40:59.765395+0000","last_active":"2024-05-09T01:45:16.805610+0000","last_peered":"2024-05-09T01:45:16.805610+0000","last_clean":"2024-05-09T01:45:16.805610+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:45:16.805610+0000","last_undegraded":"2024-05-09T01:45:16.805610+0000","last_fullsized":"2024-05-09T01:45:16.805610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:51.868145+0000","last_change":"2024-05-09T01:40:58.749832+0000","last_active":"2024-05-09T01:43:51.868145+0000","last_peered":"2024-05-09T01:43:51.868145+0000","last_clean":"2024-05-09T01:43:51.868145+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:43:51.868145+0000","last_undegraded":"2024-05-09T01:43:51.868145+0000","last_fullsized":"2024-05-09T01:43:51.868145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'128","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.514881+0000","last_change":"2024-05-09T01:40:59.753702+0000","last_active":"2024-05-09T01:45:21.514881+0000","last_peered":"2024-05-09T01:45:21.514881+0000","last_clean":"2024-05-09T01:45:21.514881+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:45:21.514881+0000","last_undegraded":"2024-05-09T01:45:21.514881+0000","last_fullsized":"2024-05-09T01:45:21.514881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'183","reported_seq":209,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.148401+0000","last_change":"2024-05-09T01:45:21.148449+0000","last_active":"2024-05-09T01:45:21.148401+0000","last_peered":"2024-05-09T01:45:21.148401+0000","last_clean":"2024-05-09T01:45:21.148401+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:45:21.148401+0000","last_undegraded":"2024-05-09T01:45:21.148401+0000","last_fullsized":"2024-05-09T01:45:21.148401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'183","last_scrub_stamp":"2024-05-09T01:45:21.148255+0000","last_deep_scrub":"23'183","last_deep_scrub_stamp":"2024-05-09T01:45:21.148255+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.148255+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:15.378335+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:32.249346+0000","last_change":"2024-05-09T01:40:58.756632+0000","last_active":"2024-05-09T01:43:32.249346+0000","last_peered":"2024-05-09T01:43:32.249346+0000","last_clean":"2024-05-09T01:43:32.249346+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:43:32.249346+0000","last_undegraded":"2024-05-09T01:43:32.249346+0000","last_fullsized":"2024-05-09T01:43:32.249346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'141","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.826452+0000","last_change":"2024-05-09T01:40:59.756149+0000","last_active":"2024-05-09T01:45:16.826452+0000","last_peered":"2024-05-09T01:45:16.826452+0000","last_clean":"2024-05-09T01:45:16.826452+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:45:16.826452+0000","last_undegraded":"2024-05-09T01:45:16.826452+0000","last_fullsized":"2024-05-09T01:45:16.826452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'13","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:43:51.868241+0000","last_change":"2024-05-09T01:40:58.756242+0000","last_active":"2024-05-09T01:43:51.868241+0000","last_peered":"2024-05-09T01:43:51.868241+0000","last_clean":"2024-05-09T01:43:51.868241+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:43:51.868241+0000","last_undegraded":"2024-05-09T01:43:51.868241+0000","last_fullsized":"2024-05-09T01:43:51.868241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'135","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.868284+0000","last_change":"2024-05-09T01:40:59.759645+0000","last_active":"2024-05-09T01:45:16.868284+0000","last_peered":"2024-05-09T01:45:16.868284+0000","last_clean":"2024-05-09T01:45:16.868284+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:45:16.868284+0000","last_undegraded":"2024-05-09T01:45:16.868284+0000","last_fullsized":"2024-05-09T01:45:16.868284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:01.256934+0000","last_change":"2024-05-09T01:40:58.757950+0000","last_active":"2024-05-09T01:45:01.256934+0000","last_peered":"2024-05-09T01:45:01.256934+0000","last_clean":"2024-05-09T01:45:01.256934+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:45:01.256934+0000","last_undegraded":"2024-05-09T01:45:01.256934+0000","last_fullsized":"2024-05-09T01:45:01.256934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:57.722294+0000","last_clean_scrub_stamp":"2024-05-09T01:40:57.722294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'152","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:16.850495+0000","last_change":"2024-05-09T01:40:59.751510+0000","last_active":"2024-05-09T01:45:16.850495+0000","last_peered":"2024-05-09T01:45:16.850495+0000","last_clean":"2024-05-09T01:45:16.850495+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:45:16.850495+0000","last_undegraded":"2024-05-09T01:45:16.850495+0000","last_fullsized":"2024-05-09T01:45:16.850495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T01:40:58.727864+0000","last_clean_scrub_stamp":"2024-05-09T01:40:58.727864+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'19","reported_seq":48,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:18.544874+0000","last_change":"2024-05-09T01:45:18.544916+0000","last_active":"2024-05-09T01:45:18.544874+0000","last_peered":"2024-05-09T01:45:18.544874+0000","last_clean":"2024-05-09T01:45:18.544874+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:45:18.544874+0000","last_undegraded":"2024-05-09T01:45:18.544874+0000","last_fullsized":"2024-05-09T01:45:18.544874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-05-09T01:45:18.544786+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-05-09T01:45:18.544786+0000","last_clean_scrub_stamp":"2024-05-09T01:45:18.544786+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:29.275702+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9718,"ondisk_log_size":9718,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":210463,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":346,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":671744,"data_stored":420926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40340,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331500,"statfs":{"total":96636764160,"available":96595456000,"internally_reserved":0,"allocated":864256,"data_stored":678687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":288799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39772,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":282624,"data_stored":90151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":289338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542202,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39760,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332080,"statfs":{"total":96636764160,"available":96596049920,"internally_reserved":0,"allocated":270336,"data_stored":88186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":262144,"data_stored":87169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":676879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":258048,"data_stored":87549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":203701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":203162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:45:22.366 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.366 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.366 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.366 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.367 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.368 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.369 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.370 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.371 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.372 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T01:40:46.917312+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=46, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.373 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.374 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-09T01:40:57.722294+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=57, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T01:40:58.727864+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=40, tm_sec=58, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=1, tm_min=45, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T01:45:22.375 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T01:45:32.469 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:32.472 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:42.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:45:42.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.509+0000 7fde54a54640 1 Processor -- start 2024-05-09T01:45:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.510+0000 7fde54a54640 1 -- start start 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde54a54640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde50157100 0x7fde50160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde54a54640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fde50160ed0 0x7fde500ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde54a54640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde500c7bf0 con 0x7fde500cdaa0 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde54a54640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fde500c79a0 con 0x7fde50157100 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde54a54640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fde500c7ed0 con 0x7fde50160ed0 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde4dd9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde50157100 0x7fde50160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde4e59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fde500cdaa0 0x7fde500ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51822/0 (socket says 172.21.15.42:51822) 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.511+0000 7fde4e59c640 1 -- 172.21.15.42:0/800922008 learned_addr learned my addr 172.21.15.42:0/800922008 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4ed9d640 1 --2- 172.21.15.42:0/800922008 >> v2:172.21.15.181:3300/0 conn(0x7fde50160ed0 0x7fde500ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4dd9b640 1 -- 172.21.15.42:0/800922008 >> v2:172.21.15.181:3300/0 conn(0x7fde50160ed0 msgr2=0x7fde500ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4dd9b640 1 --2- 172.21.15.42:0/800922008 >> v2:172.21.15.181:3300/0 conn(0x7fde50160ed0 0x7fde500ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4dd9b640 1 -- 172.21.15.42:0/800922008 >> v1:172.21.15.42:6789/0 conn(0x7fde500cdaa0 legacy=0x7fde500ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4d59a640 1 -- 172.21.15.42:0/800922008 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826869007 0 0) 0x7fde500c7bf0 con 0x7fde500cdaa0 2024-05-09T01:45:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4dd9b640 1 -- 172.21.15.42:0/800922008 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde500c81b0 con 0x7fde50157100 2024-05-09T01:45:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.512+0000 7fde4dd9b640 1 --2- 172.21.15.42:0/800922008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50157100 0x7fde50160990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fde500c93a0 tx=0x7fde4402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a728ca8631897a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde4d59a640 1 -- 172.21.15.42:0/800922008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44037070 con 0x7fde50157100 2024-05-09T01:45:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde4d59a640 1 -- 172.21.15.42:0/800922008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde44032440 con 0x7fde50157100 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde4d59a640 1 -- 172.21.15.42:0/800922008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44032810 con 0x7fde50157100 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 -- 172.21.15.42:0/800922008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50157100 msgr2=0x7fde50160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 --2- 172.21.15.42:0/800922008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50157100 0x7fde50160990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fde500c93a0 tx=0x7fde4402a1a0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 -- 172.21.15.42:0/800922008 shutdown_connections 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 --2- 172.21.15.42:0/800922008 >> v2:172.21.15.181:3300/0 conn(0x7fde50160ed0 0x7fde500ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 --2- 172.21.15.42:0/800922008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50157100 0x7fde50160990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 -- 172.21.15.42:0/800922008 >> 172.21.15.42:0/800922008 conn(0x7fde50068610 msgr2=0x7fde50068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 -- 172.21.15.42:0/800922008 shutdown_connections 2024-05-09T01:45:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.513+0000 7fde54a54640 1 -- 172.21.15.42:0/800922008 wait complete. 2024-05-09T01:45:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.515+0000 7fde54a54640 1 Processor -- start 2024-05-09T01:45:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.516+0000 7fde54a54640 1 -- start start 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde54a54640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500cdaa0 0x7fde501f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde54a54640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fde50157100 0x7fde5015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde54a54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 0x7fde5015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde54a54640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde50160470 con 0x7fde50160ed0 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde54a54640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fde500c8770 con 0x7fde500cdaa0 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde54a54640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fde500ce7e0 con 0x7fde50157100 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 0x7fde5015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 0x7fde5015ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51026/0 (socket says 172.21.15.42:51026) 2024-05-09T01:45:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 -- 172.21.15.42:0/552107149 learned_addr learned my addr 172.21.15.42:0/552107149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4e59c640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500cdaa0 0x7fde501f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4dd9b640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fde50157100 0x7fde5015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 -- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fde50157100 msgr2=0x7fde5015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fde50157100 0x7fde5015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 -- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500cdaa0 msgr2=0x7fde501f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500cdaa0 0x7fde501f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.517+0000 7fde4ed9d640 1 -- 172.21.15.42:0/552107149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde501f7670 con 0x7fde50160ed0 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.518+0000 7fde4ed9d640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 0x7fde5015ad80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d5a0 tx=0x7fde4800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.518+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480125f0 con 0x7fde50160ed0 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.518+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48019070 con 0x7fde50160ed0 2024-05-09T01:45:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.518+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde501527b0 con 0x7fde50160ed0 2024-05-09T01:45:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.518+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480129f0 con 0x7fde50160ed0 2024-05-09T01:45:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.518+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde501f3880 con 0x7fde50160ed0 2024-05-09T01:45:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.519+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde501533c0 con 0x7fde50160ed0 2024-05-09T01:45:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.520+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde48012b90 con 0x7fde50160ed0 2024-05-09T01:45:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.520+0000 7fde3effd640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fde300762d0 0x7fde300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.520+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fde480978b0 con 0x7fde50160ed0 2024-05-09T01:45:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.521+0000 7fde4e59c640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fde300762d0 0x7fde300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.521+0000 7fde4e59c640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fde300762d0 0x7fde300787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde400012e0 tx=0x7fde40001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:42.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.525+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde48060b50 con 0x7fde50160ed0 2024-05-09T01:45:42.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.718+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 --> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde50152560 con 0x7fde300762d0 2024-05-09T01:45:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.726+0000 7fde3effd640 1 -- 172.21.15.42:0/552107149 <== mgr.4100 v2:172.21.15.181:6832/112467660 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253460 (secure 0 0 0) 0x7fde50152560 con 0x7fde300762d0 2024-05-09T01:45:42.726 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:42.727 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fde300762d0 msgr2=0x7fde300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fde300762d0 0x7fde300787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde400012e0 tx=0x7fde40001630 comp rx=0 tx=0).stop 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 msgr2=0x7fde5015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 0x7fde5015ad80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d5a0 tx=0x7fde4800da60 comp rx=0 tx=0).stop 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 shutdown_connections 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fde300762d0 0x7fde300787e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50160ed0 0x7fde5015ad80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fde50157100 0x7fde5015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 --2- 172.21.15.42:0/552107149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500cdaa0 0x7fde501f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 >> 172.21.15.42:0/552107149 conn(0x7fde50068610 msgr2=0x7fde500b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 shutdown_connections 2024-05-09T01:45:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.729+0000 7fde54a54640 1 -- 172.21.15.42:0/552107149 wait complete. 2024-05-09T01:45:42.738 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-05-09T01:45:42.287338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":800831,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9664,"num_write_kb":25167770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10189,"ondisk_log_size":10189,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290488,"kb_used_data":3640,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754684232,"statfs":{"total":773094113280,"available":772796653568,"internally_reserved":0,"allocated":3727360,"data_stored":2286758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003285"},"pg_stats":[{"pgid":"3.3f","version":"23'146","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.831078+0000","last_change":"2024-05-09T01:45:25.831110+0000","last_active":"2024-05-09T01:45:25.831078+0000","last_peered":"2024-05-09T01:45:25.831078+0000","last_clean":"2024-05-09T01:45:25.831078+0000","last_became_active":"2024-05-09T01:41:41.347858+0000","last_became_peered":"2024-05-09T01:41:41.347858+0000","last_unstale":"2024-05-09T01:45:25.831078+0000","last_undegraded":"2024-05-09T01:45:25.831078+0000","last_fullsized":"2024-05-09T01:45:25.831078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-05-09T01:45:25.830968+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-05-09T01:45:25.830968+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.830968+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:37.961559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"23'130","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:30.566631+0000","last_change":"2024-05-09T01:45:30.566695+0000","last_active":"2024-05-09T01:45:30.566631+0000","last_peered":"2024-05-09T01:45:30.566631+0000","last_clean":"2024-05-09T01:45:30.566631+0000","last_became_active":"2024-05-09T01:40:59.754697+0000","last_became_peered":"2024-05-09T01:40:59.754697+0000","last_unstale":"2024-05-09T01:45:30.566631+0000","last_undegraded":"2024-05-09T01:45:30.566631+0000","last_fullsized":"2024-05-09T01:45:30.566631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-05-09T01:45:30.566489+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-05-09T01:45:30.566489+0000","last_clean_scrub_stamp":"2024-05-09T01:45:30.566489+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:18.203617+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'151","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.614204+0000","last_change":"2024-05-09T01:45:26.614237+0000","last_active":"2024-05-09T01:45:26.614204+0000","last_peered":"2024-05-09T01:45:26.614204+0000","last_clean":"2024-05-09T01:45:26.614204+0000","last_became_active":"2024-05-09T01:40:59.759026+0000","last_became_peered":"2024-05-09T01:40:59.759026+0000","last_unstale":"2024-05-09T01:45:26.614204+0000","last_undegraded":"2024-05-09T01:45:26.614204+0000","last_fullsized":"2024-05-09T01:45:26.614204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-05-09T01:45:26.614102+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-05-09T01:45:26.614102+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.614102+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:21.629474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'173","reported_seq":200,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:32.107725+0000","last_change":"2024-05-09T01:45:32.107776+0000","last_active":"2024-05-09T01:45:32.107725+0000","last_peered":"2024-05-09T01:45:32.107725+0000","last_clean":"2024-05-09T01:45:32.107725+0000","last_became_active":"2024-05-09T01:40:59.758217+0000","last_became_peered":"2024-05-09T01:40:59.758217+0000","last_unstale":"2024-05-09T01:45:32.107725+0000","last_undegraded":"2024-05-09T01:45:32.107725+0000","last_fullsized":"2024-05-09T01:45:32.107725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'173","last_scrub_stamp":"2024-05-09T01:45:32.107556+0000","last_deep_scrub":"23'173","last_deep_scrub_stamp":"2024-05-09T01:45:32.107556+0000","last_clean_scrub_stamp":"2024-05-09T01:45:32.107556+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:12.067697+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'148","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:30.261152+0000","last_change":"2024-05-09T01:45:30.261218+0000","last_active":"2024-05-09T01:45:30.261152+0000","last_peered":"2024-05-09T01:45:30.261152+0000","last_clean":"2024-05-09T01:45:30.261152+0000","last_became_active":"2024-05-09T01:40:59.761040+0000","last_became_peered":"2024-05-09T01:40:59.761040+0000","last_unstale":"2024-05-09T01:45:30.261152+0000","last_undegraded":"2024-05-09T01:45:30.261152+0000","last_fullsized":"2024-05-09T01:45:30.261152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'148","last_scrub_stamp":"2024-05-09T01:45:30.261036+0000","last_deep_scrub":"23'148","last_deep_scrub_stamp":"2024-05-09T01:45:30.261036+0000","last_clean_scrub_stamp":"2024-05-09T01:45:30.261036+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:31.160696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'135","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:35.180537+0000","last_change":"2024-05-09T01:45:35.180566+0000","last_active":"2024-05-09T01:45:35.180537+0000","last_peered":"2024-05-09T01:45:35.180537+0000","last_clean":"2024-05-09T01:45:35.180537+0000","last_became_active":"2024-05-09T01:40:59.762550+0000","last_became_peered":"2024-05-09T01:40:59.762550+0000","last_unstale":"2024-05-09T01:45:35.180537+0000","last_undegraded":"2024-05-09T01:45:35.180537+0000","last_fullsized":"2024-05-09T01:45:35.180537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-05-09T01:45:35.180412+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-05-09T01:45:35.180412+0000","last_clean_scrub_stamp":"2024-05-09T01:45:35.180412+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:36.829724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'164","reported_seq":190,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:32.262612+0000","last_change":"2024-05-09T01:45:32.262642+0000","last_active":"2024-05-09T01:45:32.262612+0000","last_peered":"2024-05-09T01:45:32.262612+0000","last_clean":"2024-05-09T01:45:32.262612+0000","last_became_active":"2024-05-09T01:40:59.763894+0000","last_became_peered":"2024-05-09T01:40:59.763894+0000","last_unstale":"2024-05-09T01:45:32.262612+0000","last_undegraded":"2024-05-09T01:45:32.262612+0000","last_fullsized":"2024-05-09T01:45:32.262612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'164","last_scrub_stamp":"2024-05-09T01:45:32.262514+0000","last_deep_scrub":"23'164","last_deep_scrub_stamp":"2024-05-09T01:45:32.262514+0000","last_clean_scrub_stamp":"2024-05-09T01:45:32.262514+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:03.508337+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'186","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.462622+0000","last_change":"2024-05-09T01:45:23.462653+0000","last_active":"2024-05-09T01:45:23.462622+0000","last_peered":"2024-05-09T01:45:23.462622+0000","last_clean":"2024-05-09T01:45:23.462622+0000","last_became_active":"2024-05-09T01:40:59.747562+0000","last_became_peered":"2024-05-09T01:40:59.747562+0000","last_unstale":"2024-05-09T01:45:23.462622+0000","last_undegraded":"2024-05-09T01:45:23.462622+0000","last_fullsized":"2024-05-09T01:45:23.462622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'186","last_scrub_stamp":"2024-05-09T01:45:23.462511+0000","last_deep_scrub":"23'186","last_deep_scrub_stamp":"2024-05-09T01:45:23.462511+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.462511+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:39.248229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'152","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:38.285188+0000","last_change":"2024-05-09T01:45:38.285219+0000","last_active":"2024-05-09T01:45:38.285188+0000","last_peered":"2024-05-09T01:45:38.285188+0000","last_clean":"2024-05-09T01:45:38.285188+0000","last_became_active":"2024-05-09T01:40:59.766184+0000","last_became_peered":"2024-05-09T01:40:59.766184+0000","last_unstale":"2024-05-09T01:45:38.285188+0000","last_undegraded":"2024-05-09T01:45:38.285188+0000","last_fullsized":"2024-05-09T01:45:38.285188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'152","last_scrub_stamp":"2024-05-09T01:45:38.285073+0000","last_deep_scrub":"23'152","last_deep_scrub_stamp":"2024-05-09T01:45:38.285073+0000","last_clean_scrub_stamp":"2024-05-09T01:45:38.285073+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:00.121328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'156","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:30.379884+0000","last_change":"2024-05-09T01:45:30.379917+0000","last_active":"2024-05-09T01:45:30.379884+0000","last_peered":"2024-05-09T01:45:30.379884+0000","last_clean":"2024-05-09T01:45:30.379884+0000","last_became_active":"2024-05-09T01:40:59.753404+0000","last_became_peered":"2024-05-09T01:40:59.753404+0000","last_unstale":"2024-05-09T01:45:30.379884+0000","last_undegraded":"2024-05-09T01:45:30.379884+0000","last_fullsized":"2024-05-09T01:45:30.379884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'156","last_scrub_stamp":"2024-05-09T01:45:30.379777+0000","last_deep_scrub":"23'156","last_deep_scrub_stamp":"2024-05-09T01:45:30.379777+0000","last_clean_scrub_stamp":"2024-05-09T01:45:30.379777+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:03.586386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'189","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:33.329511+0000","last_change":"2024-05-09T01:45:33.329543+0000","last_active":"2024-05-09T01:45:33.329511+0000","last_peered":"2024-05-09T01:45:33.329511+0000","last_clean":"2024-05-09T01:45:33.329511+0000","last_became_active":"2024-05-09T01:41:41.344652+0000","last_became_peered":"2024-05-09T01:41:41.344652+0000","last_unstale":"2024-05-09T01:45:33.329511+0000","last_undegraded":"2024-05-09T01:45:33.329511+0000","last_fullsized":"2024-05-09T01:45:33.329511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-05-09T01:45:33.329406+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-05-09T01:45:33.329406+0000","last_clean_scrub_stamp":"2024-05-09T01:45:33.329406+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:19.500466+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'142","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.477284+0000","last_change":"2024-05-09T01:45:23.477332+0000","last_active":"2024-05-09T01:45:23.477284+0000","last_peered":"2024-05-09T01:45:23.477284+0000","last_clean":"2024-05-09T01:45:23.477284+0000","last_became_active":"2024-05-09T01:40:59.756124+0000","last_became_peered":"2024-05-09T01:40:59.756124+0000","last_unstale":"2024-05-09T01:45:23.477284+0000","last_undegraded":"2024-05-09T01:45:23.477284+0000","last_fullsized":"2024-05-09T01:45:23.477284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'142","last_scrub_stamp":"2024-05-09T01:45:23.477141+0000","last_deep_scrub":"23'142","last_deep_scrub_stamp":"2024-05-09T01:45:23.477141+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.477141+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:40.504779+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'151","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.502855+0000","last_change":"2024-05-09T01:45:24.502889+0000","last_active":"2024-05-09T01:45:24.502855+0000","last_peered":"2024-05-09T01:45:24.502855+0000","last_clean":"2024-05-09T01:45:24.502855+0000","last_became_active":"2024-05-09T01:40:59.748822+0000","last_became_peered":"2024-05-09T01:40:59.748822+0000","last_unstale":"2024-05-09T01:45:24.502855+0000","last_undegraded":"2024-05-09T01:45:24.502855+0000","last_fullsized":"2024-05-09T01:45:24.502855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-05-09T01:45:24.502742+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-05-09T01:45:24.502742+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.502742+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:12.665695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'149","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.659195+0000","last_change":"2024-05-09T01:45:23.659195+0000","last_active":"2024-05-09T01:45:23.659195+0000","last_peered":"2024-05-09T01:45:23.659195+0000","last_clean":"2024-05-09T01:45:23.659195+0000","last_became_active":"2024-05-09T01:40:59.755917+0000","last_became_peered":"2024-05-09T01:40:59.755917+0000","last_unstale":"2024-05-09T01:45:23.659195+0000","last_undegraded":"2024-05-09T01:45:23.659195+0000","last_fullsized":"2024-05-09T01:45:23.659195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'149","last_scrub_stamp":"2024-05-09T01:45:23.659067+0000","last_deep_scrub":"23'149","last_deep_scrub_stamp":"2024-05-09T01:45:23.659067+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.659067+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:38.212463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'151","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:27.565460+0000","last_change":"2024-05-09T01:45:27.565460+0000","last_active":"2024-05-09T01:45:27.565460+0000","last_peered":"2024-05-09T01:45:27.565460+0000","last_clean":"2024-05-09T01:45:27.565460+0000","last_became_active":"2024-05-09T01:40:59.747453+0000","last_became_peered":"2024-05-09T01:40:59.747453+0000","last_unstale":"2024-05-09T01:45:27.565460+0000","last_undegraded":"2024-05-09T01:45:27.565460+0000","last_fullsized":"2024-05-09T01:45:27.565460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-05-09T01:45:27.565308+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-05-09T01:45:27.565308+0000","last_clean_scrub_stamp":"2024-05-09T01:45:27.565308+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:33.445736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'147","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:36.163242+0000","last_change":"2024-05-09T01:45:36.163242+0000","last_active":"2024-05-09T01:45:36.163242+0000","last_peered":"2024-05-09T01:45:36.163242+0000","last_clean":"2024-05-09T01:45:36.163242+0000","last_became_active":"2024-05-09T01:40:59.762957+0000","last_became_peered":"2024-05-09T01:40:59.762957+0000","last_unstale":"2024-05-09T01:45:36.163242+0000","last_undegraded":"2024-05-09T01:45:36.163242+0000","last_fullsized":"2024-05-09T01:45:36.163242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'147","last_scrub_stamp":"2024-05-09T01:45:36.163101+0000","last_deep_scrub":"23'147","last_deep_scrub_stamp":"2024-05-09T01:45:36.163101+0000","last_clean_scrub_stamp":"2024-05-09T01:45:36.163101+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:08.767407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'146","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:37.208650+0000","last_change":"2024-05-09T01:45:37.208650+0000","last_active":"2024-05-09T01:45:37.208650+0000","last_peered":"2024-05-09T01:45:37.208650+0000","last_clean":"2024-05-09T01:45:37.208650+0000","last_became_active":"2024-05-09T01:40:59.763487+0000","last_became_peered":"2024-05-09T01:40:59.763487+0000","last_unstale":"2024-05-09T01:45:37.208650+0000","last_undegraded":"2024-05-09T01:45:37.208650+0000","last_fullsized":"2024-05-09T01:45:37.208650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-05-09T01:45:37.208506+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-05-09T01:45:37.208506+0000","last_clean_scrub_stamp":"2024-05-09T01:45:37.208506+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:23.346332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'157","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.852544+0000","last_change":"2024-05-09T01:45:23.852544+0000","last_active":"2024-05-09T01:45:23.852544+0000","last_peered":"2024-05-09T01:45:23.852544+0000","last_clean":"2024-05-09T01:45:23.852544+0000","last_became_active":"2024-05-09T01:40:59.752539+0000","last_became_peered":"2024-05-09T01:40:59.752539+0000","last_unstale":"2024-05-09T01:45:23.852544+0000","last_undegraded":"2024-05-09T01:45:23.852544+0000","last_fullsized":"2024-05-09T01:45:23.852544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-05-09T01:45:23.852401+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-05-09T01:45:23.852401+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.852401+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:51.661352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'172","reported_seq":199,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:31.299906+0000","last_change":"2024-05-09T01:45:31.299906+0000","last_active":"2024-05-09T01:45:31.299906+0000","last_peered":"2024-05-09T01:45:31.299906+0000","last_clean":"2024-05-09T01:45:31.299906+0000","last_became_active":"2024-05-09T01:40:59.763293+0000","last_became_peered":"2024-05-09T01:40:59.763293+0000","last_unstale":"2024-05-09T01:45:31.299906+0000","last_undegraded":"2024-05-09T01:45:31.299906+0000","last_fullsized":"2024-05-09T01:45:31.299906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'172","last_scrub_stamp":"2024-05-09T01:45:31.299777+0000","last_deep_scrub":"23'172","last_deep_scrub_stamp":"2024-05-09T01:45:31.299777+0000","last_clean_scrub_stamp":"2024-05-09T01:45:31.299777+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:03.557725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'161","reported_seq":188,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:29.365147+0000","last_change":"2024-05-09T01:45:29.365147+0000","last_active":"2024-05-09T01:45:29.365147+0000","last_peered":"2024-05-09T01:45:29.365147+0000","last_clean":"2024-05-09T01:45:29.365147+0000","last_became_active":"2024-05-09T01:40:59.753316+0000","last_became_peered":"2024-05-09T01:40:59.753316+0000","last_unstale":"2024-05-09T01:45:29.365147+0000","last_undegraded":"2024-05-09T01:45:29.365147+0000","last_fullsized":"2024-05-09T01:45:29.365147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'161","last_scrub_stamp":"2024-05-09T01:45:29.365018+0000","last_deep_scrub":"23'161","last_deep_scrub_stamp":"2024-05-09T01:45:29.365018+0000","last_clean_scrub_stamp":"2024-05-09T01:45:29.365018+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:58.070303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'137","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:27.594059+0000","last_change":"2024-05-09T01:45:27.594059+0000","last_active":"2024-05-09T01:45:27.594059+0000","last_peered":"2024-05-09T01:45:27.594059+0000","last_clean":"2024-05-09T01:45:27.594059+0000","last_became_active":"2024-05-09T01:40:59.760366+0000","last_became_peered":"2024-05-09T01:40:59.760366+0000","last_unstale":"2024-05-09T01:45:27.594059+0000","last_undegraded":"2024-05-09T01:45:27.594059+0000","last_fullsized":"2024-05-09T01:45:27.594059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-05-09T01:45:27.593921+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-05-09T01:45:27.593921+0000","last_clean_scrub_stamp":"2024-05-09T01:45:27.593921+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:16.383089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'166","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:33.140977+0000","last_change":"2024-05-09T01:45:33.141024+0000","last_active":"2024-05-09T01:45:33.140977+0000","last_peered":"2024-05-09T01:45:33.140977+0000","last_clean":"2024-05-09T01:45:33.140977+0000","last_became_active":"2024-05-09T01:40:59.761073+0000","last_became_peered":"2024-05-09T01:40:59.761073+0000","last_unstale":"2024-05-09T01:45:33.140977+0000","last_undegraded":"2024-05-09T01:45:33.140977+0000","last_fullsized":"2024-05-09T01:45:33.140977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'166","last_scrub_stamp":"2024-05-09T01:45:33.140864+0000","last_deep_scrub":"23'166","last_deep_scrub_stamp":"2024-05-09T01:45:33.140864+0000","last_clean_scrub_stamp":"2024-05-09T01:45:33.140864+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:37.994437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'134","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:28.477494+0000","last_change":"2024-05-09T01:45:28.477494+0000","last_active":"2024-05-09T01:45:28.477494+0000","last_peered":"2024-05-09T01:45:28.477494+0000","last_clean":"2024-05-09T01:45:28.477494+0000","last_became_active":"2024-05-09T01:40:59.754328+0000","last_became_peered":"2024-05-09T01:40:59.754328+0000","last_unstale":"2024-05-09T01:45:28.477494+0000","last_undegraded":"2024-05-09T01:45:28.477494+0000","last_fullsized":"2024-05-09T01:45:28.477494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-05-09T01:45:28.477270+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-05-09T01:45:28.477270+0000","last_clean_scrub_stamp":"2024-05-09T01:45:28.477270+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:27.719506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'180","reported_seq":207,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:27.118741+0000","last_change":"2024-05-09T01:45:27.118802+0000","last_active":"2024-05-09T01:45:27.118741+0000","last_peered":"2024-05-09T01:45:27.118741+0000","last_clean":"2024-05-09T01:45:27.118741+0000","last_became_active":"2024-05-09T01:40:59.747671+0000","last_became_peered":"2024-05-09T01:40:59.747671+0000","last_unstale":"2024-05-09T01:45:27.118741+0000","last_undegraded":"2024-05-09T01:45:27.118741+0000","last_fullsized":"2024-05-09T01:45:27.118741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'180","last_scrub_stamp":"2024-05-09T01:45:27.118621+0000","last_deep_scrub":"23'180","last_deep_scrub_stamp":"2024-05-09T01:45:27.118621+0000","last_clean_scrub_stamp":"2024-05-09T01:45:27.118621+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:49.695389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'134","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:29.489825+0000","last_change":"2024-05-09T01:45:29.489865+0000","last_active":"2024-05-09T01:45:29.489825+0000","last_peered":"2024-05-09T01:45:29.489825+0000","last_clean":"2024-05-09T01:45:29.489825+0000","last_became_active":"2024-05-09T01:40:59.756651+0000","last_became_peered":"2024-05-09T01:40:59.756651+0000","last_unstale":"2024-05-09T01:45:29.489825+0000","last_undegraded":"2024-05-09T01:45:29.489825+0000","last_fullsized":"2024-05-09T01:45:29.489825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-05-09T01:45:29.489715+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-05-09T01:45:29.489715+0000","last_clean_scrub_stamp":"2024-05-09T01:45:29.489715+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:13.178920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'198","reported_seq":225,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:31.365210+0000","last_change":"2024-05-09T01:45:31.365241+0000","last_active":"2024-05-09T01:45:31.365210+0000","last_peered":"2024-05-09T01:45:31.365210+0000","last_clean":"2024-05-09T01:45:31.365210+0000","last_became_active":"2024-05-09T01:40:59.760862+0000","last_became_peered":"2024-05-09T01:40:59.760862+0000","last_unstale":"2024-05-09T01:45:31.365210+0000","last_undegraded":"2024-05-09T01:45:31.365210+0000","last_fullsized":"2024-05-09T01:45:31.365210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'198","last_scrub_stamp":"2024-05-09T01:45:31.365094+0000","last_deep_scrub":"23'198","last_deep_scrub_stamp":"2024-05-09T01:45:31.365094+0000","last_clean_scrub_stamp":"2024-05-09T01:45:31.365094+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:06.543283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'144","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:29.524996+0000","last_change":"2024-05-09T01:45:29.525078+0000","last_active":"2024-05-09T01:45:29.524996+0000","last_peered":"2024-05-09T01:45:29.524996+0000","last_clean":"2024-05-09T01:45:29.524996+0000","last_became_active":"2024-05-09T01:40:59.748594+0000","last_became_peered":"2024-05-09T01:40:59.748594+0000","last_unstale":"2024-05-09T01:45:29.524996+0000","last_undegraded":"2024-05-09T01:45:29.524996+0000","last_fullsized":"2024-05-09T01:45:29.524996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-05-09T01:45:29.524857+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-05-09T01:45:29.524857+0000","last_clean_scrub_stamp":"2024-05-09T01:45:29.524857+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:09.012408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'133","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:27.473973+0000","last_change":"2024-05-09T01:45:27.474056+0000","last_active":"2024-05-09T01:45:27.473973+0000","last_peered":"2024-05-09T01:45:27.473973+0000","last_clean":"2024-05-09T01:45:27.473973+0000","last_became_active":"2024-05-09T01:40:59.753356+0000","last_became_peered":"2024-05-09T01:40:59.753356+0000","last_unstale":"2024-05-09T01:45:27.473973+0000","last_undegraded":"2024-05-09T01:45:27.473973+0000","last_fullsized":"2024-05-09T01:45:27.473973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'133","last_scrub_stamp":"2024-05-09T01:45:27.473816+0000","last_deep_scrub":"23'133","last_deep_scrub_stamp":"2024-05-09T01:45:27.473816+0000","last_clean_scrub_stamp":"2024-05-09T01:45:27.473816+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:12.886427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'118","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:29.562487+0000","last_change":"2024-05-09T01:45:29.562519+0000","last_active":"2024-05-09T01:45:29.562487+0000","last_peered":"2024-05-09T01:45:29.562487+0000","last_clean":"2024-05-09T01:45:29.562487+0000","last_became_active":"2024-05-09T01:40:59.759219+0000","last_became_peered":"2024-05-09T01:40:59.759219+0000","last_unstale":"2024-05-09T01:45:29.562487+0000","last_undegraded":"2024-05-09T01:45:29.562487+0000","last_fullsized":"2024-05-09T01:45:29.562487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'118","last_scrub_stamp":"2024-05-09T01:45:29.562384+0000","last_deep_scrub":"23'118","last_deep_scrub_stamp":"2024-05-09T01:45:29.562384+0000","last_clean_scrub_stamp":"2024-05-09T01:45:29.562384+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:44.265803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:28.112664+0000","last_change":"2024-05-09T01:45:28.112704+0000","last_active":"2024-05-09T01:45:28.112664+0000","last_peered":"2024-05-09T01:45:28.112664+0000","last_clean":"2024-05-09T01:45:28.112664+0000","last_became_active":"2024-05-09T01:40:59.748315+0000","last_became_peered":"2024-05-09T01:40:59.748315+0000","last_unstale":"2024-05-09T01:45:28.112664+0000","last_undegraded":"2024-05-09T01:45:28.112664+0000","last_fullsized":"2024-05-09T01:45:28.112664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-05-09T01:45:28.112554+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-05-09T01:45:28.112554+0000","last_clean_scrub_stamp":"2024-05-09T01:45:28.112554+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:58.716797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'135","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.875657+0000","last_change":"2024-05-09T01:45:26.875730+0000","last_active":"2024-05-09T01:45:26.875657+0000","last_peered":"2024-05-09T01:45:26.875657+0000","last_clean":"2024-05-09T01:45:26.875657+0000","last_became_active":"2024-05-09T01:41:41.643556+0000","last_became_peered":"2024-05-09T01:41:41.643556+0000","last_unstale":"2024-05-09T01:45:26.875657+0000","last_undegraded":"2024-05-09T01:45:26.875657+0000","last_fullsized":"2024-05-09T01:45:26.875657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-05-09T01:45:26.875542+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-05-09T01:45:26.875542+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.875542+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:12.981059+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'150","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:32.320383+0000","last_change":"2024-05-09T01:45:32.320464+0000","last_active":"2024-05-09T01:45:32.320383+0000","last_peered":"2024-05-09T01:45:32.320383+0000","last_clean":"2024-05-09T01:45:32.320383+0000","last_became_active":"2024-05-09T01:40:59.762118+0000","last_became_peered":"2024-05-09T01:40:59.762118+0000","last_unstale":"2024-05-09T01:45:32.320383+0000","last_undegraded":"2024-05-09T01:45:32.320383+0000","last_fullsized":"2024-05-09T01:45:32.320383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-05-09T01:45:32.320264+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-05-09T01:45:32.320264+0000","last_clean_scrub_stamp":"2024-05-09T01:45:32.320264+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:14:11.456568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'130","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.507509+0000","last_change":"2024-05-09T01:45:22.507571+0000","last_active":"2024-05-09T01:45:22.507509+0000","last_peered":"2024-05-09T01:45:22.507509+0000","last_clean":"2024-05-09T01:45:22.507509+0000","last_became_active":"2024-05-09T01:40:59.753805+0000","last_became_peered":"2024-05-09T01:40:59.753805+0000","last_unstale":"2024-05-09T01:45:22.507509+0000","last_undegraded":"2024-05-09T01:45:22.507509+0000","last_fullsized":"2024-05-09T01:45:22.507509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-05-09T01:45:22.507378+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-05-09T01:45:22.507378+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.507378+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.620344+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'8","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.462132+0000","last_change":"2024-05-09T01:45:20.462189+0000","last_active":"2024-05-09T01:45:20.462132+0000","last_peered":"2024-05-09T01:45:20.462132+0000","last_clean":"2024-05-09T01:45:20.462132+0000","last_became_active":"2024-05-09T01:40:58.749000+0000","last_became_peered":"2024-05-09T01:40:58.749000+0000","last_unstale":"2024-05-09T01:45:20.462132+0000","last_undegraded":"2024-05-09T01:45:20.462132+0000","last_fullsized":"2024-05-09T01:45:20.462132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-09T01:45:20.462034+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-09T01:45:20.462034+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.462034+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:05.006755+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'137","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.622525+0000","last_change":"2024-05-09T01:45:22.622549+0000","last_active":"2024-05-09T01:45:22.622525+0000","last_peered":"2024-05-09T01:45:22.622525+0000","last_clean":"2024-05-09T01:45:22.622525+0000","last_became_active":"2024-05-09T01:40:59.754061+0000","last_became_peered":"2024-05-09T01:40:59.754061+0000","last_unstale":"2024-05-09T01:45:22.622525+0000","last_undegraded":"2024-05-09T01:45:22.622525+0000","last_fullsized":"2024-05-09T01:45:22.622525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-05-09T01:45:22.622440+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-05-09T01:45:22.622440+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.622440+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:06.909917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.290587+0000","last_change":"2024-05-09T01:45:22.290628+0000","last_active":"2024-05-09T01:45:22.290587+0000","last_peered":"2024-05-09T01:45:22.290587+0000","last_clean":"2024-05-09T01:45:22.290587+0000","last_became_active":"2024-05-09T01:40:58.748753+0000","last_became_peered":"2024-05-09T01:40:58.748753+0000","last_unstale":"2024-05-09T01:45:22.290587+0000","last_undegraded":"2024-05-09T01:45:22.290587+0000","last_fullsized":"2024-05-09T01:45:22.290587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-05-09T01:45:22.290474+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-05-09T01:45:22.290474+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.290474+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:15.902307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'5","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.420292+0000","last_change":"2024-05-09T01:45:21.420362+0000","last_active":"2024-05-09T01:45:21.420292+0000","last_peered":"2024-05-09T01:45:21.420292+0000","last_clean":"2024-05-09T01:45:21.420292+0000","last_became_active":"2024-05-09T01:40:58.753798+0000","last_became_peered":"2024-05-09T01:40:58.753798+0000","last_unstale":"2024-05-09T01:45:21.420292+0000","last_undegraded":"2024-05-09T01:45:21.420292+0000","last_fullsized":"2024-05-09T01:45:21.420292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-09T01:45:21.420196+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-09T01:45:21.420196+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.420196+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:29.476853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'170","reported_seq":196,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:30.538911+0000","last_change":"2024-05-09T01:45:30.538963+0000","last_active":"2024-05-09T01:45:30.538911+0000","last_peered":"2024-05-09T01:45:30.538911+0000","last_clean":"2024-05-09T01:45:30.538911+0000","last_became_active":"2024-05-09T01:40:59.763183+0000","last_became_peered":"2024-05-09T01:40:59.763183+0000","last_unstale":"2024-05-09T01:45:30.538911+0000","last_undegraded":"2024-05-09T01:45:30.538911+0000","last_fullsized":"2024-05-09T01:45:30.538911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'170","last_scrub_stamp":"2024-05-09T01:45:30.538798+0000","last_deep_scrub":"23'170","last_deep_scrub_stamp":"2024-05-09T01:45:30.538798+0000","last_clean_scrub_stamp":"2024-05-09T01:45:30.538798+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:55:38.287111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.127630+0000","last_change":"2024-05-09T01:45:23.127664+0000","last_active":"2024-05-09T01:45:23.127630+0000","last_peered":"2024-05-09T01:45:23.127630+0000","last_clean":"2024-05-09T01:45:23.127630+0000","last_became_active":"2024-05-09T01:40:58.751682+0000","last_became_peered":"2024-05-09T01:40:58.751682+0000","last_unstale":"2024-05-09T01:45:23.127630+0000","last_undegraded":"2024-05-09T01:45:23.127630+0000","last_fullsized":"2024-05-09T01:45:23.127630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-09T01:45:23.127519+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-09T01:45:23.127519+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.127519+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.134304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'157","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.613101+0000","last_change":"2024-05-09T01:45:26.613132+0000","last_active":"2024-05-09T01:45:26.613101+0000","last_peered":"2024-05-09T01:45:26.613101+0000","last_clean":"2024-05-09T01:45:26.613101+0000","last_became_active":"2024-05-09T01:40:59.746662+0000","last_became_peered":"2024-05-09T01:40:59.746662+0000","last_unstale":"2024-05-09T01:45:26.613101+0000","last_undegraded":"2024-05-09T01:45:26.613101+0000","last_fullsized":"2024-05-09T01:45:26.613101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-05-09T01:45:26.612992+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-05-09T01:45:26.612992+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.612992+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:03.709614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.396694+0000","last_change":"2024-05-09T01:45:26.396723+0000","last_active":"2024-05-09T01:45:26.396694+0000","last_peered":"2024-05-09T01:45:26.396694+0000","last_clean":"2024-05-09T01:45:26.396694+0000","last_became_active":"2024-05-09T01:40:58.752031+0000","last_became_peered":"2024-05-09T01:40:58.752031+0000","last_unstale":"2024-05-09T01:45:26.396694+0000","last_undegraded":"2024-05-09T01:45:26.396694+0000","last_fullsized":"2024-05-09T01:45:26.396694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-05-09T01:45:26.396604+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-05-09T01:45:26.396604+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.396604+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:04.251013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'229","reported_seq":255,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:34.172141+0000","last_change":"2024-05-09T01:45:34.172199+0000","last_active":"2024-05-09T01:45:34.172141+0000","last_peered":"2024-05-09T01:45:34.172141+0000","last_clean":"2024-05-09T01:45:34.172141+0000","last_became_active":"2024-05-09T01:40:59.761858+0000","last_became_peered":"2024-05-09T01:40:59.761858+0000","last_unstale":"2024-05-09T01:45:34.172141+0000","last_undegraded":"2024-05-09T01:45:34.172141+0000","last_fullsized":"2024-05-09T01:45:34.172141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'229","last_scrub_stamp":"2024-05-09T01:45:34.171945+0000","last_deep_scrub":"23'229","last_deep_scrub_stamp":"2024-05-09T01:45:34.171945+0000","last_clean_scrub_stamp":"2024-05-09T01:45:34.171945+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:32.358707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'6","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.160669+0000","last_change":"2024-05-09T01:45:26.160725+0000","last_active":"2024-05-09T01:45:26.160669+0000","last_peered":"2024-05-09T01:45:26.160669+0000","last_clean":"2024-05-09T01:45:26.160669+0000","last_became_active":"2024-05-09T01:40:58.755162+0000","last_became_peered":"2024-05-09T01:40:58.755162+0000","last_unstale":"2024-05-09T01:45:26.160669+0000","last_undegraded":"2024-05-09T01:45:26.160669+0000","last_fullsized":"2024-05-09T01:45:26.160669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-09T01:45:26.160563+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-09T01:45:26.160563+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.160563+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:45.092741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'141","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.605341+0000","last_change":"2024-05-09T01:45:21.605373+0000","last_active":"2024-05-09T01:45:21.605341+0000","last_peered":"2024-05-09T01:45:21.605341+0000","last_clean":"2024-05-09T01:45:21.605341+0000","last_became_active":"2024-05-09T01:40:59.753653+0000","last_became_peered":"2024-05-09T01:40:59.753653+0000","last_unstale":"2024-05-09T01:45:21.605341+0000","last_undegraded":"2024-05-09T01:45:21.605341+0000","last_fullsized":"2024-05-09T01:45:21.605341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-05-09T01:45:21.605227+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-05-09T01:45:21.605227+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.605227+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:06.162950+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'13","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.572981+0000","last_change":"2024-05-09T01:45:22.573016+0000","last_active":"2024-05-09T01:45:22.572981+0000","last_peered":"2024-05-09T01:45:22.572981+0000","last_clean":"2024-05-09T01:45:22.572981+0000","last_became_active":"2024-05-09T01:40:58.756258+0000","last_became_peered":"2024-05-09T01:40:58.756258+0000","last_unstale":"2024-05-09T01:45:22.572981+0000","last_undegraded":"2024-05-09T01:45:22.572981+0000","last_fullsized":"2024-05-09T01:45:22.572981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-05-09T01:45:22.572890+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-05-09T01:45:22.572890+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.572890+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:46.811323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'149","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.442688+0000","last_change":"2024-05-09T01:45:24.442688+0000","last_active":"2024-05-09T01:45:24.442688+0000","last_peered":"2024-05-09T01:45:24.442688+0000","last_clean":"2024-05-09T01:45:24.442688+0000","last_became_active":"2024-05-09T01:40:59.761474+0000","last_became_peered":"2024-05-09T01:40:59.761474+0000","last_unstale":"2024-05-09T01:45:24.442688+0000","last_undegraded":"2024-05-09T01:45:24.442688+0000","last_fullsized":"2024-05-09T01:45:24.442688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'149","last_scrub_stamp":"2024-05-09T01:45:24.442540+0000","last_deep_scrub":"23'149","last_deep_scrub_stamp":"2024-05-09T01:45:24.442540+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.442540+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:19.220928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'100","reported_seq":129,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.360487+0000","last_change":"2024-05-09T01:45:25.360487+0000","last_active":"2024-05-09T01:45:25.360487+0000","last_peered":"2024-05-09T01:45:25.360487+0000","last_clean":"2024-05-09T01:45:25.360487+0000","last_became_active":"2024-05-09T01:40:58.751876+0000","last_became_peered":"2024-05-09T01:40:58.751876+0000","last_unstale":"2024-05-09T01:45:25.360487+0000","last_undegraded":"2024-05-09T01:45:25.360487+0000","last_fullsized":"2024-05-09T01:45:25.360487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'100","last_scrub_stamp":"2024-05-09T01:45:25.360341+0000","last_deep_scrub":"23'100","last_deep_scrub_stamp":"2024-05-09T01:45:25.360341+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.360341+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:47.992266+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'150","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.298596+0000","last_change":"2024-05-09T01:45:22.298640+0000","last_active":"2024-05-09T01:45:22.298596+0000","last_peered":"2024-05-09T01:45:22.298596+0000","last_clean":"2024-05-09T01:45:22.298596+0000","last_became_active":"2024-05-09T01:40:59.762510+0000","last_became_peered":"2024-05-09T01:40:59.762510+0000","last_unstale":"2024-05-09T01:45:22.298596+0000","last_undegraded":"2024-05-09T01:45:22.298596+0000","last_fullsized":"2024-05-09T01:45:22.298596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-05-09T01:45:22.298490+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-05-09T01:45:22.298490+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.298490+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:54.113525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'15","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.591021+0000","last_change":"2024-05-09T01:45:19.591021+0000","last_active":"2024-05-09T01:45:19.591021+0000","last_peered":"2024-05-09T01:45:19.591021+0000","last_clean":"2024-05-09T01:45:19.591021+0000","last_became_active":"2024-05-09T01:40:58.754896+0000","last_became_peered":"2024-05-09T01:40:58.754896+0000","last_unstale":"2024-05-09T01:45:19.591021+0000","last_undegraded":"2024-05-09T01:45:19.591021+0000","last_fullsized":"2024-05-09T01:45:19.591021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-05-09T01:45:19.590807+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-05-09T01:45:19.590807+0000","last_clean_scrub_stamp":"2024-05-09T01:45:19.590807+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:59.045182+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'157","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:28.550143+0000","last_change":"2024-05-09T01:45:28.550143+0000","last_active":"2024-05-09T01:45:28.550143+0000","last_peered":"2024-05-09T01:45:28.550143+0000","last_clean":"2024-05-09T01:45:28.550143+0000","last_became_active":"2024-05-09T01:40:59.760948+0000","last_became_peered":"2024-05-09T01:40:59.760948+0000","last_unstale":"2024-05-09T01:45:28.550143+0000","last_undegraded":"2024-05-09T01:45:28.550143+0000","last_fullsized":"2024-05-09T01:45:28.550143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-05-09T01:45:28.549997+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-05-09T01:45:28.549997+0000","last_clean_scrub_stamp":"2024-05-09T01:45:28.549997+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:08.561707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'8","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.146983+0000","last_change":"2024-05-09T01:45:25.146983+0000","last_active":"2024-05-09T01:45:25.146983+0000","last_peered":"2024-05-09T01:45:25.146983+0000","last_clean":"2024-05-09T01:45:25.146983+0000","last_became_active":"2024-05-09T01:40:58.754563+0000","last_became_peered":"2024-05-09T01:40:58.754563+0000","last_unstale":"2024-05-09T01:45:25.146983+0000","last_undegraded":"2024-05-09T01:45:25.146983+0000","last_fullsized":"2024-05-09T01:45:25.146983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-09T01:45:25.146778+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-09T01:45:25.146778+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.146778+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:08:43.137001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'171","reported_seq":198,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:35.337770+0000","last_change":"2024-05-09T01:45:35.337770+0000","last_active":"2024-05-09T01:45:35.337770+0000","last_peered":"2024-05-09T01:45:35.337770+0000","last_clean":"2024-05-09T01:45:35.337770+0000","last_became_active":"2024-05-09T01:40:59.765879+0000","last_became_peered":"2024-05-09T01:40:59.765879+0000","last_unstale":"2024-05-09T01:45:35.337770+0000","last_undegraded":"2024-05-09T01:45:35.337770+0000","last_fullsized":"2024-05-09T01:45:35.337770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'171","last_scrub_stamp":"2024-05-09T01:45:35.337584+0000","last_deep_scrub":"23'171","last_deep_scrub_stamp":"2024-05-09T01:45:35.337584+0000","last_clean_scrub_stamp":"2024-05-09T01:45:35.337584+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:29.193763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'9","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.314328+0000","last_change":"2024-05-09T01:45:23.314328+0000","last_active":"2024-05-09T01:45:23.314328+0000","last_peered":"2024-05-09T01:45:23.314328+0000","last_clean":"2024-05-09T01:45:23.314328+0000","last_became_active":"2024-05-09T01:40:58.749581+0000","last_became_peered":"2024-05-09T01:40:58.749581+0000","last_unstale":"2024-05-09T01:45:23.314328+0000","last_undegraded":"2024-05-09T01:45:23.314328+0000","last_fullsized":"2024-05-09T01:45:23.314328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-09T01:45:23.314190+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-09T01:45:23.314190+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.314190+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:47.904569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'165","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:27.398077+0000","last_change":"2024-05-09T01:45:27.398077+0000","last_active":"2024-05-09T01:45:27.398077+0000","last_peered":"2024-05-09T01:45:27.398077+0000","last_clean":"2024-05-09T01:45:27.398077+0000","last_became_active":"2024-05-09T01:40:59.749824+0000","last_became_peered":"2024-05-09T01:40:59.749824+0000","last_unstale":"2024-05-09T01:45:27.398077+0000","last_undegraded":"2024-05-09T01:45:27.398077+0000","last_fullsized":"2024-05-09T01:45:27.398077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'165","last_scrub_stamp":"2024-05-09T01:45:27.397919+0000","last_deep_scrub":"23'165","last_deep_scrub_stamp":"2024-05-09T01:45:27.397919+0000","last_clean_scrub_stamp":"2024-05-09T01:45:27.397919+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:27.142691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'26","reported_seq":55,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.895965+0000","last_change":"2024-05-09T01:45:19.895965+0000","last_active":"2024-05-09T01:45:19.895965+0000","last_peered":"2024-05-09T01:45:19.895965+0000","last_clean":"2024-05-09T01:45:19.895965+0000","last_became_active":"2024-05-09T01:40:58.749814+0000","last_became_peered":"2024-05-09T01:40:58.749814+0000","last_unstale":"2024-05-09T01:45:19.895965+0000","last_undegraded":"2024-05-09T01:45:19.895965+0000","last_fullsized":"2024-05-09T01:45:19.895965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'26","last_scrub_stamp":"2024-05-09T01:45:19.895835+0000","last_deep_scrub":"23'26","last_deep_scrub_stamp":"2024-05-09T01:45:19.895835+0000","last_clean_scrub_stamp":"2024-05-09T01:45:19.895835+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:22.340657+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'189","reported_seq":216,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:34.343969+0000","last_change":"2024-05-09T01:45:34.343969+0000","last_active":"2024-05-09T01:45:34.343969+0000","last_peered":"2024-05-09T01:45:34.343969+0000","last_clean":"2024-05-09T01:45:34.343969+0000","last_became_active":"2024-05-09T01:40:59.764331+0000","last_became_peered":"2024-05-09T01:40:59.764331+0000","last_unstale":"2024-05-09T01:45:34.343969+0000","last_undegraded":"2024-05-09T01:45:34.343969+0000","last_fullsized":"2024-05-09T01:45:34.343969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-05-09T01:45:34.343786+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-05-09T01:45:34.343786+0000","last_clean_scrub_stamp":"2024-05-09T01:45:34.343786+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:30.988006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.530475+0000","last_change":"2024-05-09T01:45:20.530475+0000","last_active":"2024-05-09T01:45:20.530475+0000","last_peered":"2024-05-09T01:45:20.530475+0000","last_clean":"2024-05-09T01:45:20.530475+0000","last_became_active":"2024-05-09T01:40:58.752153+0000","last_became_peered":"2024-05-09T01:40:58.752153+0000","last_unstale":"2024-05-09T01:45:20.530475+0000","last_undegraded":"2024-05-09T01:45:20.530475+0000","last_fullsized":"2024-05-09T01:45:20.530475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-09T01:45:20.530348+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-09T01:45:20.530348+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.530348+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:52:22.704143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'146","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:33.296654+0000","last_change":"2024-05-09T01:45:33.296701+0000","last_active":"2024-05-09T01:45:33.296654+0000","last_peered":"2024-05-09T01:45:33.296654+0000","last_clean":"2024-05-09T01:45:33.296654+0000","last_became_active":"2024-05-09T01:40:59.763931+0000","last_became_peered":"2024-05-09T01:40:59.763931+0000","last_unstale":"2024-05-09T01:45:33.296654+0000","last_undegraded":"2024-05-09T01:45:33.296654+0000","last_fullsized":"2024-05-09T01:45:33.296654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-05-09T01:45:33.296515+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-05-09T01:45:33.296515+0000","last_clean_scrub_stamp":"2024-05-09T01:45:33.296515+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:08.718714+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'7","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.868744+0000","last_change":"2024-05-09T01:45:21.868744+0000","last_active":"2024-05-09T01:45:21.868744+0000","last_peered":"2024-05-09T01:45:21.868744+0000","last_clean":"2024-05-09T01:45:21.868744+0000","last_became_active":"2024-05-09T01:40:58.753253+0000","last_became_peered":"2024-05-09T01:40:58.753253+0000","last_unstale":"2024-05-09T01:45:21.868744+0000","last_undegraded":"2024-05-09T01:45:21.868744+0000","last_fullsized":"2024-05-09T01:45:21.868744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-09T01:45:21.868614+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-09T01:45:21.868614+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.868614+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:12:22.167824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'138","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:36.340772+0000","last_change":"2024-05-09T01:45:36.340802+0000","last_active":"2024-05-09T01:45:36.340772+0000","last_peered":"2024-05-09T01:45:36.340772+0000","last_clean":"2024-05-09T01:45:36.340772+0000","last_became_active":"2024-05-09T01:40:59.765855+0000","last_became_peered":"2024-05-09T01:40:59.765855+0000","last_unstale":"2024-05-09T01:45:36.340772+0000","last_undegraded":"2024-05-09T01:45:36.340772+0000","last_fullsized":"2024-05-09T01:45:36.340772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'138","last_scrub_stamp":"2024-05-09T01:45:36.340669+0000","last_deep_scrub":"23'138","last_deep_scrub_stamp":"2024-05-09T01:45:36.340669+0000","last_clean_scrub_stamp":"2024-05-09T01:45:36.340669+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:47.423626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.631317+0000","last_change":"2024-05-09T01:45:20.631317+0000","last_active":"2024-05-09T01:45:20.631317+0000","last_peered":"2024-05-09T01:45:20.631317+0000","last_clean":"2024-05-09T01:45:20.631317+0000","last_became_active":"2024-05-09T01:40:58.751518+0000","last_became_peered":"2024-05-09T01:40:58.751518+0000","last_unstale":"2024-05-09T01:45:20.631317+0000","last_undegraded":"2024-05-09T01:45:20.631317+0000","last_fullsized":"2024-05-09T01:45:20.631317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-09T01:45:20.631152+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-09T01:45:20.631152+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.631152+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:13.734471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'144","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:29.141680+0000","last_change":"2024-05-09T01:45:29.141680+0000","last_active":"2024-05-09T01:45:29.141680+0000","last_peered":"2024-05-09T01:45:29.141680+0000","last_clean":"2024-05-09T01:45:29.141680+0000","last_became_active":"2024-05-09T01:40:59.751822+0000","last_became_peered":"2024-05-09T01:40:59.751822+0000","last_unstale":"2024-05-09T01:45:29.141680+0000","last_undegraded":"2024-05-09T01:45:29.141680+0000","last_fullsized":"2024-05-09T01:45:29.141680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-05-09T01:45:29.141523+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-05-09T01:45:29.141523+0000","last_clean_scrub_stamp":"2024-05-09T01:45:29.141523+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:11.558236+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'9","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.852171+0000","last_change":"2024-05-09T01:45:20.852171+0000","last_active":"2024-05-09T01:45:20.852171+0000","last_peered":"2024-05-09T01:45:20.852171+0000","last_clean":"2024-05-09T01:45:20.852171+0000","last_became_active":"2024-05-09T01:40:58.749723+0000","last_became_peered":"2024-05-09T01:40:58.749723+0000","last_unstale":"2024-05-09T01:45:20.852171+0000","last_undegraded":"2024-05-09T01:45:20.852171+0000","last_fullsized":"2024-05-09T01:45:20.852171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-09T01:45:20.852052+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-09T01:45:20.852052+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.852052+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:48.687974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'151","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:37.332584+0000","last_change":"2024-05-09T01:45:37.332613+0000","last_active":"2024-05-09T01:45:37.332584+0000","last_peered":"2024-05-09T01:45:37.332584+0000","last_clean":"2024-05-09T01:45:37.332584+0000","last_became_active":"2024-05-09T01:40:59.766099+0000","last_became_peered":"2024-05-09T01:40:59.766099+0000","last_unstale":"2024-05-09T01:45:37.332584+0000","last_undegraded":"2024-05-09T01:45:37.332584+0000","last_fullsized":"2024-05-09T01:45:37.332584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-05-09T01:45:37.332480+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-05-09T01:45:37.332480+0000","last_clean_scrub_stamp":"2024-05-09T01:45:37.332480+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:55.559277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.319672+0000","last_change":"2024-05-09T01:45:23.319746+0000","last_active":"2024-05-09T01:45:23.319672+0000","last_peered":"2024-05-09T01:45:23.319672+0000","last_clean":"2024-05-09T01:45:23.319672+0000","last_became_active":"2024-05-09T01:40:48.165895+0000","last_became_peered":"2024-05-09T01:40:48.165895+0000","last_unstale":"2024-05-09T01:45:23.319672+0000","last_undegraded":"2024-05-09T01:45:23.319672+0000","last_fullsized":"2024-05-09T01:45:23.319672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-05-09T01:45:23.319558+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-05-09T01:45:23.319558+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.319558+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:54.621323+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'11","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.114324+0000","last_change":"2024-05-09T01:45:22.114371+0000","last_active":"2024-05-09T01:45:22.114324+0000","last_peered":"2024-05-09T01:45:22.114324+0000","last_clean":"2024-05-09T01:45:22.114324+0000","last_became_active":"2024-05-09T01:40:58.750302+0000","last_became_peered":"2024-05-09T01:40:58.750302+0000","last_unstale":"2024-05-09T01:45:22.114324+0000","last_undegraded":"2024-05-09T01:45:22.114324+0000","last_fullsized":"2024-05-09T01:45:22.114324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-09T01:45:22.114221+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-09T01:45:22.114221+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.114221+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:16.007075+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'158","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.823739+0000","last_change":"2024-05-09T01:45:24.823778+0000","last_active":"2024-05-09T01:45:24.823739+0000","last_peered":"2024-05-09T01:45:24.823739+0000","last_clean":"2024-05-09T01:45:24.823739+0000","last_became_active":"2024-05-09T01:41:41.345116+0000","last_became_peered":"2024-05-09T01:41:41.345116+0000","last_unstale":"2024-05-09T01:45:24.823739+0000","last_undegraded":"2024-05-09T01:45:24.823739+0000","last_fullsized":"2024-05-09T01:45:24.823739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'158","last_scrub_stamp":"2024-05-09T01:45:24.823627+0000","last_deep_scrub":"23'158","last_deep_scrub_stamp":"2024-05-09T01:45:24.823627+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.823627+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:16.183635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.294459+0000","last_change":"2024-05-09T01:45:25.294489+0000","last_active":"2024-05-09T01:45:25.294459+0000","last_peered":"2024-05-09T01:45:25.294459+0000","last_clean":"2024-05-09T01:45:25.294459+0000","last_became_active":"2024-05-09T01:40:58.753395+0000","last_became_peered":"2024-05-09T01:40:58.753395+0000","last_unstale":"2024-05-09T01:45:25.294459+0000","last_undegraded":"2024-05-09T01:45:25.294459+0000","last_fullsized":"2024-05-09T01:45:25.294459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-09T01:45:25.294359+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-09T01:45:25.294359+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.294359+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:14.665333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:20.570470+0000","last_change":"2024-05-09T01:45:20.570526+0000","last_active":"2024-05-09T01:45:20.570470+0000","last_peered":"2024-05-09T01:45:20.570470+0000","last_clean":"2024-05-09T01:45:20.570470+0000","last_became_active":"2024-05-09T01:40:59.754004+0000","last_became_peered":"2024-05-09T01:40:59.754004+0000","last_unstale":"2024-05-09T01:45:20.570470+0000","last_undegraded":"2024-05-09T01:45:20.570470+0000","last_fullsized":"2024-05-09T01:45:20.570470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-05-09T01:45:20.570365+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-05-09T01:45:20.570365+0000","last_clean_scrub_stamp":"2024-05-09T01:45:20.570365+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:50.318844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'14","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.828867+0000","last_change":"2024-05-09T01:45:22.828899+0000","last_active":"2024-05-09T01:45:22.828867+0000","last_peered":"2024-05-09T01:45:22.828867+0000","last_clean":"2024-05-09T01:45:22.828867+0000","last_became_active":"2024-05-09T01:40:58.752882+0000","last_became_peered":"2024-05-09T01:40:58.752882+0000","last_unstale":"2024-05-09T01:45:22.828867+0000","last_undegraded":"2024-05-09T01:45:22.828867+0000","last_fullsized":"2024-05-09T01:45:22.828867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-05-09T01:45:22.828776+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-05-09T01:45:22.828776+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.828776+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:27.232383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.581406+0000","last_change":"2024-05-09T01:45:25.581436+0000","last_active":"2024-05-09T01:45:25.581406+0000","last_peered":"2024-05-09T01:45:25.581406+0000","last_clean":"2024-05-09T01:45:25.581406+0000","last_became_active":"2024-05-09T01:40:59.745656+0000","last_became_peered":"2024-05-09T01:40:59.745656+0000","last_unstale":"2024-05-09T01:45:25.581406+0000","last_undegraded":"2024-05-09T01:45:25.581406+0000","last_fullsized":"2024-05-09T01:45:25.581406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-05-09T01:45:25.581292+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-05-09T01:45:25.581292+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.581292+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:09.061399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'7","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.142472+0000","last_change":"2024-05-09T01:45:24.142546+0000","last_active":"2024-05-09T01:45:24.142472+0000","last_peered":"2024-05-09T01:45:24.142472+0000","last_clean":"2024-05-09T01:45:24.142472+0000","last_became_active":"2024-05-09T01:40:58.752167+0000","last_became_peered":"2024-05-09T01:40:58.752167+0000","last_unstale":"2024-05-09T01:45:24.142472+0000","last_undegraded":"2024-05-09T01:45:24.142472+0000","last_fullsized":"2024-05-09T01:45:24.142472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-09T01:45:24.142345+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-09T01:45:24.142345+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.142345+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:20.995417+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'146","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.424605+0000","last_change":"2024-05-09T01:45:25.424632+0000","last_active":"2024-05-09T01:45:25.424605+0000","last_peered":"2024-05-09T01:45:25.424605+0000","last_clean":"2024-05-09T01:45:25.424605+0000","last_became_active":"2024-05-09T01:40:59.762535+0000","last_became_peered":"2024-05-09T01:40:59.762535+0000","last_unstale":"2024-05-09T01:45:25.424605+0000","last_undegraded":"2024-05-09T01:45:25.424605+0000","last_fullsized":"2024-05-09T01:45:25.424605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-05-09T01:45:25.424506+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-05-09T01:45:25.424506+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.424506+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:28.073905+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.584960+0000","last_change":"2024-05-09T01:45:21.585009+0000","last_active":"2024-05-09T01:45:21.584960+0000","last_peered":"2024-05-09T01:45:21.584960+0000","last_clean":"2024-05-09T01:45:21.584960+0000","last_became_active":"2024-05-09T01:40:58.754469+0000","last_became_peered":"2024-05-09T01:40:58.754469+0000","last_unstale":"2024-05-09T01:45:21.584960+0000","last_undegraded":"2024-05-09T01:45:21.584960+0000","last_fullsized":"2024-05-09T01:45:21.584960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2024-05-09T01:45:21.584812+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2024-05-09T01:45:21.584812+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.584812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:36.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'143","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:31.107533+0000","last_change":"2024-05-09T01:45:31.107572+0000","last_active":"2024-05-09T01:45:31.107533+0000","last_peered":"2024-05-09T01:45:31.107533+0000","last_clean":"2024-05-09T01:45:31.107533+0000","last_became_active":"2024-05-09T01:40:59.756888+0000","last_became_peered":"2024-05-09T01:40:59.756888+0000","last_unstale":"2024-05-09T01:45:31.107533+0000","last_undegraded":"2024-05-09T01:45:31.107533+0000","last_fullsized":"2024-05-09T01:45:31.107533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-05-09T01:45:31.107396+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-05-09T01:45:31.107396+0000","last_clean_scrub_stamp":"2024-05-09T01:45:31.107396+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:33.367216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'7","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.334682+0000","last_change":"2024-05-09T01:45:26.334719+0000","last_active":"2024-05-09T01:45:26.334682+0000","last_peered":"2024-05-09T01:45:26.334682+0000","last_clean":"2024-05-09T01:45:26.334682+0000","last_became_active":"2024-05-09T01:40:58.754461+0000","last_became_peered":"2024-05-09T01:40:58.754461+0000","last_unstale":"2024-05-09T01:45:26.334682+0000","last_undegraded":"2024-05-09T01:45:26.334682+0000","last_fullsized":"2024-05-09T01:45:26.334682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-09T01:45:26.334580+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-09T01:45:26.334580+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.334580+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:29.150503+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'144","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:28.547769+0000","last_change":"2024-05-09T01:45:28.547820+0000","last_active":"2024-05-09T01:45:28.547769+0000","last_peered":"2024-05-09T01:45:28.547769+0000","last_clean":"2024-05-09T01:45:28.547769+0000","last_became_active":"2024-05-09T01:40:59.747586+0000","last_became_peered":"2024-05-09T01:40:59.747586+0000","last_unstale":"2024-05-09T01:45:28.547769+0000","last_undegraded":"2024-05-09T01:45:28.547769+0000","last_fullsized":"2024-05-09T01:45:28.547769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-05-09T01:45:28.547657+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-05-09T01:45:28.547657+0000","last_clean_scrub_stamp":"2024-05-09T01:45:28.547657+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:37:22.155521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'27","reported_seq":56,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.568616+0000","last_change":"2024-05-09T01:45:24.568693+0000","last_active":"2024-05-09T01:45:24.568616+0000","last_peered":"2024-05-09T01:45:24.568616+0000","last_clean":"2024-05-09T01:45:24.568616+0000","last_became_active":"2024-05-09T01:40:58.755949+0000","last_became_peered":"2024-05-09T01:40:58.755949+0000","last_unstale":"2024-05-09T01:45:24.568616+0000","last_undegraded":"2024-05-09T01:45:24.568616+0000","last_fullsized":"2024-05-09T01:45:24.568616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'27","last_scrub_stamp":"2024-05-09T01:45:24.568472+0000","last_deep_scrub":"23'27","last_deep_scrub_stamp":"2024-05-09T01:45:24.568472+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.568472+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:55.489693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'143","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:31.555695+0000","last_change":"2024-05-09T01:45:31.555757+0000","last_active":"2024-05-09T01:45:31.555695+0000","last_peered":"2024-05-09T01:45:31.555695+0000","last_clean":"2024-05-09T01:45:31.555695+0000","last_became_active":"2024-05-09T01:40:59.763574+0000","last_became_peered":"2024-05-09T01:40:59.763574+0000","last_unstale":"2024-05-09T01:45:31.555695+0000","last_undegraded":"2024-05-09T01:45:31.555695+0000","last_fullsized":"2024-05-09T01:45:31.555695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-05-09T01:45:31.555546+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-05-09T01:45:31.555546+0000","last_clean_scrub_stamp":"2024-05-09T01:45:31.555546+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.697961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'12","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.355026+0000","last_change":"2024-05-09T01:45:24.355064+0000","last_active":"2024-05-09T01:45:24.355026+0000","last_peered":"2024-05-09T01:45:24.355026+0000","last_clean":"2024-05-09T01:45:24.355026+0000","last_became_active":"2024-05-09T01:40:58.751092+0000","last_became_peered":"2024-05-09T01:40:58.751092+0000","last_unstale":"2024-05-09T01:45:24.355026+0000","last_undegraded":"2024-05-09T01:45:24.355026+0000","last_fullsized":"2024-05-09T01:45:24.355026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-05-09T01:45:24.354909+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-05-09T01:45:24.354909+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.354909+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:04.646431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'163","reported_seq":190,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.615172+0000","last_change":"2024-05-09T01:45:24.615203+0000","last_active":"2024-05-09T01:45:24.615172+0000","last_peered":"2024-05-09T01:45:24.615172+0000","last_clean":"2024-05-09T01:45:24.615172+0000","last_became_active":"2024-05-09T01:40:59.754818+0000","last_became_peered":"2024-05-09T01:40:59.754818+0000","last_unstale":"2024-05-09T01:45:24.615172+0000","last_undegraded":"2024-05-09T01:45:24.615172+0000","last_fullsized":"2024-05-09T01:45:24.615172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'163","last_scrub_stamp":"2024-05-09T01:45:24.615066+0000","last_deep_scrub":"23'163","last_deep_scrub_stamp":"2024-05-09T01:45:24.615066+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.615066+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:20.409844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:27.340292+0000","last_change":"2024-05-09T01:45:27.340337+0000","last_active":"2024-05-09T01:45:27.340292+0000","last_peered":"2024-05-09T01:45:27.340292+0000","last_clean":"2024-05-09T01:45:27.340292+0000","last_became_active":"2024-05-09T01:40:58.754588+0000","last_became_peered":"2024-05-09T01:40:58.754588+0000","last_unstale":"2024-05-09T01:45:27.340292+0000","last_undegraded":"2024-05-09T01:45:27.340292+0000","last_fullsized":"2024-05-09T01:45:27.340292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-09T01:45:27.340187+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-09T01:45:27.340187+0000","last_clean_scrub_stamp":"2024-05-09T01:45:27.340187+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:05.438222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'134","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.530433+0000","last_change":"2024-05-09T01:45:21.530493+0000","last_active":"2024-05-09T01:45:21.530433+0000","last_peered":"2024-05-09T01:45:21.530433+0000","last_clean":"2024-05-09T01:45:21.530433+0000","last_became_active":"2024-05-09T01:40:59.750138+0000","last_became_peered":"2024-05-09T01:40:59.750138+0000","last_unstale":"2024-05-09T01:45:21.530433+0000","last_undegraded":"2024-05-09T01:45:21.530433+0000","last_fullsized":"2024-05-09T01:45:21.530433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-05-09T01:45:21.530319+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-05-09T01:45:21.530319+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.530319+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:16.533307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'11","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:19.669040+0000","last_change":"2024-05-09T01:45:19.669040+0000","last_active":"2024-05-09T01:45:19.669040+0000","last_peered":"2024-05-09T01:45:19.669040+0000","last_clean":"2024-05-09T01:45:19.669040+0000","last_became_active":"2024-05-09T01:40:58.749767+0000","last_became_peered":"2024-05-09T01:40:58.749767+0000","last_unstale":"2024-05-09T01:45:19.669040+0000","last_undegraded":"2024-05-09T01:45:19.669040+0000","last_fullsized":"2024-05-09T01:45:19.669040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-09T01:45:19.668850+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-09T01:45:19.668850+0000","last_clean_scrub_stamp":"2024-05-09T01:45:19.668850+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:51.597170+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'153","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.507054+0000","last_change":"2024-05-09T01:45:25.507088+0000","last_active":"2024-05-09T01:45:25.507054+0000","last_peered":"2024-05-09T01:45:25.507054+0000","last_clean":"2024-05-09T01:45:25.507054+0000","last_became_active":"2024-05-09T01:40:59.751140+0000","last_became_peered":"2024-05-09T01:40:59.751140+0000","last_unstale":"2024-05-09T01:45:25.507054+0000","last_undegraded":"2024-05-09T01:45:25.507054+0000","last_fullsized":"2024-05-09T01:45:25.507054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'153","last_scrub_stamp":"2024-05-09T01:45:25.506933+0000","last_deep_scrub":"23'153","last_deep_scrub_stamp":"2024-05-09T01:45:25.506933+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.506933+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:40.018150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:23.569083+0000","last_change":"2024-05-09T01:45:23.569168+0000","last_active":"2024-05-09T01:45:23.569083+0000","last_peered":"2024-05-09T01:45:23.569083+0000","last_clean":"2024-05-09T01:45:23.569083+0000","last_became_active":"2024-05-09T01:40:58.752137+0000","last_became_peered":"2024-05-09T01:40:58.752137+0000","last_unstale":"2024-05-09T01:45:23.569083+0000","last_undegraded":"2024-05-09T01:45:23.569083+0000","last_fullsized":"2024-05-09T01:45:23.569083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-09T01:45:23.568956+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-09T01:45:23.568956+0000","last_clean_scrub_stamp":"2024-05-09T01:45:23.568956+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:21.464752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'143","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:32.600586+0000","last_change":"2024-05-09T01:45:32.600646+0000","last_active":"2024-05-09T01:45:32.600586+0000","last_peered":"2024-05-09T01:45:32.600586+0000","last_clean":"2024-05-09T01:45:32.600586+0000","last_became_active":"2024-05-09T01:40:59.763404+0000","last_became_peered":"2024-05-09T01:40:59.763404+0000","last_unstale":"2024-05-09T01:45:32.600586+0000","last_undegraded":"2024-05-09T01:45:32.600586+0000","last_fullsized":"2024-05-09T01:45:32.600586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-05-09T01:45:32.600424+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-05-09T01:45:32.600424+0000","last_clean_scrub_stamp":"2024-05-09T01:45:32.600424+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:31:08.595392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'7","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:24.332676+0000","last_change":"2024-05-09T01:45:24.332676+0000","last_active":"2024-05-09T01:45:24.332676+0000","last_peered":"2024-05-09T01:45:24.332676+0000","last_clean":"2024-05-09T01:45:24.332676+0000","last_became_active":"2024-05-09T01:40:58.749316+0000","last_became_peered":"2024-05-09T01:40:58.749316+0000","last_unstale":"2024-05-09T01:45:24.332676+0000","last_undegraded":"2024-05-09T01:45:24.332676+0000","last_fullsized":"2024-05-09T01:45:24.332676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-09T01:45:24.332529+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-09T01:45:24.332529+0000","last_clean_scrub_stamp":"2024-05-09T01:45:24.332529+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:42.985576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'128","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:28.360911+0000","last_change":"2024-05-09T01:45:28.360943+0000","last_active":"2024-05-09T01:45:28.360911+0000","last_peered":"2024-05-09T01:45:28.360911+0000","last_clean":"2024-05-09T01:45:28.360911+0000","last_became_active":"2024-05-09T01:40:59.753004+0000","last_became_peered":"2024-05-09T01:40:59.753004+0000","last_unstale":"2024-05-09T01:45:28.360911+0000","last_undegraded":"2024-05-09T01:45:28.360911+0000","last_fullsized":"2024-05-09T01:45:28.360911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'128","last_scrub_stamp":"2024-05-09T01:45:28.360812+0000","last_deep_scrub":"23'128","last_deep_scrub_stamp":"2024-05-09T01:45:28.360812+0000","last_clean_scrub_stamp":"2024-05-09T01:45:28.360812+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:30.428814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'183","reported_seq":209,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:21.148401+0000","last_change":"2024-05-09T01:45:21.148449+0000","last_active":"2024-05-09T01:45:21.148401+0000","last_peered":"2024-05-09T01:45:21.148401+0000","last_clean":"2024-05-09T01:45:21.148401+0000","last_became_active":"2024-05-09T01:40:59.752963+0000","last_became_peered":"2024-05-09T01:40:59.752963+0000","last_unstale":"2024-05-09T01:45:21.148401+0000","last_undegraded":"2024-05-09T01:45:21.148401+0000","last_fullsized":"2024-05-09T01:45:21.148401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'183","last_scrub_stamp":"2024-05-09T01:45:21.148255+0000","last_deep_scrub":"23'183","last_deep_scrub_stamp":"2024-05-09T01:45:21.148255+0000","last_clean_scrub_stamp":"2024-05-09T01:45:21.148255+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:15.378335+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'8","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:29.310582+0000","last_change":"2024-05-09T01:45:29.310664+0000","last_active":"2024-05-09T01:45:29.310582+0000","last_peered":"2024-05-09T01:45:29.310582+0000","last_clean":"2024-05-09T01:45:29.310582+0000","last_became_active":"2024-05-09T01:40:58.756275+0000","last_became_peered":"2024-05-09T01:40:58.756275+0000","last_unstale":"2024-05-09T01:45:29.310582+0000","last_undegraded":"2024-05-09T01:45:29.310582+0000","last_fullsized":"2024-05-09T01:45:29.310582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-09T01:45:29.310456+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-09T01:45:29.310456+0000","last_clean_scrub_stamp":"2024-05-09T01:45:29.310456+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:50.104080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'141","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:30.104687+0000","last_change":"2024-05-09T01:45:30.104716+0000","last_active":"2024-05-09T01:45:30.104687+0000","last_peered":"2024-05-09T01:45:30.104687+0000","last_clean":"2024-05-09T01:45:30.104687+0000","last_became_active":"2024-05-09T01:40:59.755818+0000","last_became_peered":"2024-05-09T01:40:59.755818+0000","last_unstale":"2024-05-09T01:45:30.104687+0000","last_undegraded":"2024-05-09T01:45:30.104687+0000","last_fullsized":"2024-05-09T01:45:30.104687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-05-09T01:45:30.104575+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-05-09T01:45:30.104575+0000","last_clean_scrub_stamp":"2024-05-09T01:45:30.104575+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:54.188420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'20","reported_seq":48,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:28.305867+0000","last_change":"2024-05-09T01:45:28.305914+0000","last_active":"2024-05-09T01:45:28.305867+0000","last_peered":"2024-05-09T01:45:28.305867+0000","last_clean":"2024-05-09T01:45:28.305867+0000","last_became_active":"2024-05-09T01:40:58.755919+0000","last_became_peered":"2024-05-09T01:40:58.755919+0000","last_unstale":"2024-05-09T01:45:28.305867+0000","last_undegraded":"2024-05-09T01:45:28.305867+0000","last_fullsized":"2024-05-09T01:45:28.305867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-05-09T01:45:28.305767+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-05-09T01:45:28.305767+0000","last_clean_scrub_stamp":"2024-05-09T01:45:28.305767+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:51.478449+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'135","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:25.644593+0000","last_change":"2024-05-09T01:45:25.644658+0000","last_active":"2024-05-09T01:45:25.644593+0000","last_peered":"2024-05-09T01:45:25.644593+0000","last_clean":"2024-05-09T01:45:25.644593+0000","last_became_active":"2024-05-09T01:40:59.758643+0000","last_became_peered":"2024-05-09T01:40:59.758643+0000","last_unstale":"2024-05-09T01:45:25.644593+0000","last_undegraded":"2024-05-09T01:45:25.644593+0000","last_fullsized":"2024-05-09T01:45:25.644593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-05-09T01:45:25.644453+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-05-09T01:45:25.644453+0000","last_clean_scrub_stamp":"2024-05-09T01:45:25.644453+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:31.920001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:22.438346+0000","last_change":"2024-05-09T01:45:22.438381+0000","last_active":"2024-05-09T01:45:22.438346+0000","last_peered":"2024-05-09T01:45:22.438346+0000","last_clean":"2024-05-09T01:45:22.438346+0000","last_became_active":"2024-05-09T01:40:58.755292+0000","last_became_peered":"2024-05-09T01:40:58.755292+0000","last_unstale":"2024-05-09T01:45:22.438346+0000","last_undegraded":"2024-05-09T01:45:22.438346+0000","last_fullsized":"2024-05-09T01:45:22.438346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2024-05-09T01:45:22.438256+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2024-05-09T01:45:22.438256+0000","last_clean_scrub_stamp":"2024-05-09T01:45:22.438256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:34.821998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'152","reported_seq":179,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:26.474762+0000","last_change":"2024-05-09T01:45:26.474828+0000","last_active":"2024-05-09T01:45:26.474762+0000","last_peered":"2024-05-09T01:45:26.474762+0000","last_clean":"2024-05-09T01:45:26.474762+0000","last_became_active":"2024-05-09T01:40:59.751208+0000","last_became_peered":"2024-05-09T01:40:59.751208+0000","last_unstale":"2024-05-09T01:45:26.474762+0000","last_undegraded":"2024-05-09T01:45:26.474762+0000","last_fullsized":"2024-05-09T01:45:26.474762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'152","last_scrub_stamp":"2024-05-09T01:45:26.474633+0000","last_deep_scrub":"23'152","last_deep_scrub_stamp":"2024-05-09T01:45:26.474633+0000","last_clean_scrub_stamp":"2024-05-09T01:45:26.474633+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:20.844332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'19","reported_seq":48,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T01:45:18.544874+0000","last_change":"2024-05-09T01:45:18.544916+0000","last_active":"2024-05-09T01:45:18.544874+0000","last_peered":"2024-05-09T01:45:18.544874+0000","last_clean":"2024-05-09T01:45:18.544874+0000","last_became_active":"2024-05-09T01:40:58.755067+0000","last_became_peered":"2024-05-09T01:40:58.755067+0000","last_unstale":"2024-05-09T01:45:18.544874+0000","last_undegraded":"2024-05-09T01:45:18.544874+0000","last_fullsized":"2024-05-09T01:45:18.544874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-05-09T01:45:18.544786+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-05-09T01:45:18.544786+0000","last_clean_scrub_stamp":"2024-05-09T01:45:18.544786+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:29.275702+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9718,"ondisk_log_size":9718,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":210463,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":346,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":671744,"data_stored":420926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":397,"ondisk_log_size":397,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40340,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331500,"statfs":{"total":96636764160,"available":96595456000,"internally_reserved":0,"allocated":864256,"data_stored":678687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":288799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39772,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":282624,"data_stored":90151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":289338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542206,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39760,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332080,"statfs":{"total":96636764160,"available":96596049920,"internally_reserved":0,"allocated":270336,"data_stored":88186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":262144,"data_stored":87169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":676879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":258048,"data_stored":87549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":203701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":203162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:45:42.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T01:45:42.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.896+0000 7fa2a70e0640 1 Processor -- start 2024-05-09T01:45:42.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.896+0000 7fa2a70e0640 1 -- start start 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.897+0000 7fa2a70e0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa2a00ce3f0 0x7fa2a0157080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.897+0000 7fa2a70e0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2a00c7660 0x7fa2a015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.897+0000 7fa2a70e0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a00cccb0 con 0x7fa2a015d2d0 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.897+0000 7fa2a70e0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a006e530 con 0x7fa2a00c7660 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.897+0000 7fa2a70e0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a006d640 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2a00c7660 0x7fa2a015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa2a567d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa2a015d2d0 0x7fa2a015d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51828/0 (socket says 172.21.15.42:51828) 2024-05-09T01:45:42.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2a00c7660 0x7fa2a015cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51034/0 (socket says 172.21.15.42:51034) 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa2a567d640 1 -- 172.21.15.42:0/752753640 learned_addr learned my addr 172.21.15.42:0/752753640 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa2a4e7c640 1 --2- 172.21.15.42:0/752753640 >> v2:172.21.15.181:3300/0 conn(0x7fa2a00ce3f0 0x7fa2a0157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29ffff640 1 -- 172.21.15.42:0/752753640 >> v2:172.21.15.181:3300/0 conn(0x7fa2a00ce3f0 msgr2=0x7fa2a0157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29ffff640 1 --2- 172.21.15.42:0/752753640 >> v2:172.21.15.181:3300/0 conn(0x7fa2a00ce3f0 0x7fa2a0157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29ffff640 1 -- 172.21.15.42:0/752753640 >> v1:172.21.15.42:6789/0 conn(0x7fa2a015d2d0 legacy=0x7fa2a015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29f7fe640 1 -- 172.21.15.42:0/752753640 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802620099 0 0) 0x7fa2a00cccb0 con 0x7fa2a015d2d0 2024-05-09T01:45:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.898+0000 7fa29ffff640 1 -- 172.21.15.42:0/752753640 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a006d920 con 0x7fa2a00c7660 2024-05-09T01:45:42.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.899+0000 7fa29ffff640 1 --2- 172.21.15.42:0/752753640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00c7660 0x7fa2a015cd90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa2a006e6b0 tx=0x7fa28802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cc4be13fe51f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.899+0000 7fa29f7fe640 1 -- 172.21.15.42:0/752753640 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288037070 con 0x7fa2a00c7660 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.899+0000 7fa29f7fe640 1 -- 172.21.15.42:0/752753640 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa288032440 con 0x7fa2a00c7660 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.899+0000 7fa29f7fe640 1 -- 172.21.15.42:0/752753640 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288032810 con 0x7fa2a00c7660 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 -- 172.21.15.42:0/752753640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00c7660 msgr2=0x7fa2a015cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/752753640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00c7660 0x7fa2a015cd90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa2a006e6b0 tx=0x7fa28802a230 comp rx=0 tx=0).stop 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 -- 172.21.15.42:0/752753640 shutdown_connections 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/752753640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00c7660 0x7fa2a015cd90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/752753640 >> v2:172.21.15.181:3300/0 conn(0x7fa2a00ce3f0 0x7fa2a0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 -- 172.21.15.42:0/752753640 >> 172.21.15.42:0/752753640 conn(0x7fa2a0068fe0 msgr2=0x7fa2a00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 -- 172.21.15.42:0/752753640 shutdown_connections 2024-05-09T01:45:42.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.900+0000 7fa2a70e0640 1 -- 172.21.15.42:0/752753640 wait complete. 2024-05-09T01:45:42.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.901+0000 7fa2a70e0640 1 Processor -- start 2024-05-09T01:45:42.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.901+0000 7fa2a70e0640 1 -- start start 2024-05-09T01:45:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a70e0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2a00c7660 0x7fa2a01f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a70e0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 0x7fa2a0151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a70e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2a015d2d0 0x7fa2a0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a70e0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a006e1c0 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a70e0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a006dee0 con 0x7fa2a015d2d0 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a70e0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a006d2e0 con 0x7fa2a00c7660 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 0x7fa2a0151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 0x7fa2a0151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51050/0 (socket says 172.21.15.42:51050) 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 -- 172.21.15.42:0/326529451 learned_addr learned my addr 172.21.15.42:0/326529451 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a4e7c640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2a00c7660 0x7fa2a01f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa2a567d640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2a015d2d0 0x7fa2a0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 -- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2a00c7660 msgr2=0x7fa2a01f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2a00c7660 0x7fa2a01f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 -- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2a015d2d0 msgr2=0x7fa2a0151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2a015d2d0 0x7fa2a0151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.903+0000 7fa29ffff640 1 -- 172.21.15.42:0/326529451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a00cd0e0 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.904+0000 7fa29ffff640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 0x7fa2a0151980 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa288035040 tx=0x7fa2880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.904+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288037050 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.904+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa288038040 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.904+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288004470 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.904+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a01f3180 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.904+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a00d11f0 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.905+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a015bac0 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.906+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa288030900 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.906+0000 7fa29d7fa640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa280076300 0x7fa280078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:42.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.906+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa2880b8c30 con 0x7fa2a00ce3f0 2024-05-09T01:45:42.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.906+0000 7fa2a4e7c640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa280076300 0x7fa280078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:42.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.907+0000 7fa2a4e7c640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa280076300 0x7fa280078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa290003aa0 tx=0x7fa290009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:42.910+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2a00cd0e0 con 0x7fa2a00ce3f0 2024-05-09T01:45:43.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.102+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa2a00ce1d0 con 0x7fa2a00ce3f0 2024-05-09T01:45:43.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.106+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fa2880820c0 con 0x7fa2a00ce3f0 2024-05-09T01:45:43.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.108+0000 7fa29d7fa640 1 -- 172.21.15.42:0/326529451 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa288032440 con 0x7fa2a00ce3f0 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa280076300 msgr2=0x7fa280078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa280076300 0x7fa280078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa290003aa0 tx=0x7fa290009830 comp rx=0 tx=0).stop 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 msgr2=0x7fa2a0151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 0x7fa2a0151980 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa288035040 tx=0x7fa2880046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 shutdown_connections 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fa280076300 0x7fa280078810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2a015d2d0 0x7fa2a0151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2a00ce3f0 0x7fa2a0151980 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 --2- 172.21.15.42:0/326529451 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2a00c7660 0x7fa2a01f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 >> 172.21.15.42:0/326529451 conn(0x7fa2a0068fe0 msgr2=0x7fa2a00cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:43.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 shutdown_connections 2024-05-09T01:45:43.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.109+0000 7fa2a70e0640 1 -- 172.21.15.42:0/326529451 wait complete. 2024-05-09T01:45:43.118 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T01:45:43.119 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:45:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.236+0000 7f88d9001640 1 Processor -- start 2024-05-09T01:45:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.236+0000 7f88d9001640 1 -- start start 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.237+0000 7f88d9001640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88d40c6f00 0x7f88d40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.237+0000 7f88d9001640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88d4156d50 0x7f88d406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.237+0000 7f88d9001640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d415db50 con 0x7f88d406da10 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.237+0000 7f88d9001640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f88d415d620 con 0x7f88d4156d50 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.237+0000 7f88d9001640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f88d40ccb10 con 0x7f88d40c6f00 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88d4156d50 0x7f88d406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88d4156d50 0x7f88d406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51060/0 (socket says 172.21.15.42:51060) 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 -- 172.21.15.42:0/1222066263 learned_addr learned my addr 172.21.15.42:0/1222066263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d2d9d640 1 --2- 172.21.15.42:0/1222066263 >> v2:172.21.15.181:3300/0 conn(0x7f88d40c6f00 0x7f88d40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 -- 172.21.15.42:0/1222066263 >> v2:172.21.15.181:3300/0 conn(0x7f88d40c6f00 msgr2=0x7f88d40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 --2- 172.21.15.42:0/1222066263 >> v2:172.21.15.181:3300/0 conn(0x7f88d40c6f00 0x7f88d40b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 -- 172.21.15.42:0/1222066263 >> v1:172.21.15.181:6789/0 conn(0x7f88d406da10 legacy=0x7f88d40cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.238+0000 7f88d259c640 1 -- 172.21.15.42:0/1222066263 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d40ce770 con 0x7f88d4156d50 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.239+0000 7f88d259c640 1 --2- 172.21.15.42:0/1222066263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d4156d50 0x7f88d406d4d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88d40d2e30 tx=0x7f88bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c9343e7fe666d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.239+0000 7f88d1d9b640 1 -- 172.21.15.42:0/1222066263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc037070 con 0x7f88d4156d50 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.239+0000 7f88d1d9b640 1 -- 172.21.15.42:0/1222066263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f88bc032440 con 0x7f88d4156d50 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.239+0000 7f88d1d9b640 1 -- 172.21.15.42:0/1222066263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc032830 con 0x7f88d4156d50 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.239+0000 7f88d9001640 1 -- 172.21.15.42:0/1222066263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d4156d50 msgr2=0x7f88d406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.239+0000 7f88d9001640 1 --2- 172.21.15.42:0/1222066263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d4156d50 0x7f88d406d4d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88d40d2e30 tx=0x7f88bc02a1e0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.240+0000 7f88d9001640 1 -- 172.21.15.42:0/1222066263 shutdown_connections 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.240+0000 7f88d9001640 1 --2- 172.21.15.42:0/1222066263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d4156d50 0x7f88d406d4d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.240+0000 7f88d9001640 1 --2- 172.21.15.42:0/1222066263 >> v2:172.21.15.181:3300/0 conn(0x7f88d40c6f00 0x7f88d40b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.240+0000 7f88d9001640 1 -- 172.21.15.42:0/1222066263 >> 172.21.15.42:0/1222066263 conn(0x7f88d4068ef0 msgr2=0x7f88d40d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.240+0000 7f88d9001640 1 -- 172.21.15.42:0/1222066263 shutdown_connections 2024-05-09T01:45:43.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.240+0000 7f88d9001640 1 -- 172.21.15.42:0/1222066263 wait complete. 2024-05-09T01:45:43.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.242+0000 7f88d9001640 1 Processor -- start 2024-05-09T01:45:43.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.242+0000 7f88d9001640 1 -- start start 2024-05-09T01:45:43.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d9001640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 0x7f88d41f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d9001640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88d40c6f00 0x7f88d4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d9001640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d4156d50 0x7f88d4157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d9001640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88d40ce430 con 0x7f88d406da10 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d9001640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88d40ccdb0 con 0x7f88d4156d50 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d9001640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f88d406eb80 con 0x7f88d40c6f00 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 0x7f88d41f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 0x7f88d41f3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51074/0 (socket says 172.21.15.42:51074) 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 -- 172.21.15.42:0/2380610097 learned_addr learned my addr 172.21.15.42:0/2380610097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d259c640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88d40c6f00 0x7f88d4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d359e640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d4156d50 0x7f88d4157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 -- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88d40c6f00 msgr2=0x7f88d4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88d40c6f00 0x7f88d4157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 -- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d4156d50 msgr2=0x7f88d4157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d4156d50 0x7f88d4157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d2d9d640 1 -- 172.21.15.42:0/2380610097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d41f3ec0 con 0x7f88d406da10 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d359e640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d4156d50 0x7f88d4157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.243+0000 7f88d259c640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88d40c6f00 0x7f88d4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.244+0000 7f88d2d9d640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 0x7f88d41f3980 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88c4007e40 tx=0x7f88c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.244+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4014620 con 0x7f88d406da10 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.244+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f88c4019070 con 0x7f88d406da10 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.244+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d41580f0 con 0x7f88d406da10 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.244+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4014a20 con 0x7f88d406da10 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.244+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d4158fd0 con 0x7f88d406da10 2024-05-09T01:45:43.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.245+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d41f4090 con 0x7f88d406da10 2024-05-09T01:45:43.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.246+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f88c4014bc0 con 0x7f88d406da10 2024-05-09T01:45:43.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.246+0000 7f88cb7fe640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f88b40762d0 0x7f88b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.246+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f88c4098050 con 0x7f88d406da10 2024-05-09T01:45:43.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.246+0000 7f88d259c640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f88b40762d0 0x7f88b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.247+0000 7f88d259c640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f88b40762d0 0x7f88b40787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88bc034000 tx=0x7f88bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.251+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f88d41f4090 con 0x7f88d406da10 2024-05-09T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.480+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88d406a5e0 con 0x7f88d406da10 2024-05-09T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.481+0000 7f88cb7fe640 1 -- 172.21.15.42:0/2380610097 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7f88c40618a0 con 0x7f88d406da10 2024-05-09T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:45:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f88b40762d0 msgr2=0x7f88b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f88b40762d0 0x7f88b40787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88bc034000 tx=0x7f88bc02e000 comp rx=0 tx=0).stop 2024-05-09T01:45:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 msgr2=0x7f88d41f3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 0x7f88d41f3980 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88c4007e40 tx=0x7f88c400e4b0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 shutdown_connections 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f88b40762d0 0x7f88b40787e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d4156d50 0x7f88d4157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88d40c6f00 0x7f88d4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 --2- 172.21.15.42:0/2380610097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d406da10 0x7f88d41f3980 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 >> 172.21.15.42:0/2380610097 conn(0x7f88d4068ef0 msgr2=0x7f88d40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 shutdown_connections 2024-05-09T01:45:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.483+0000 7f88d9001640 1 -- 172.21.15.42:0/2380610097 wait complete. 2024-05-09T01:45:43.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T01:45:43.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.609+0000 7fce89a70640 1 Processor -- start 2024-05-09T01:45:43.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.609+0000 7fce89a70640 1 -- start start 2024-05-09T01:45:43.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.610+0000 7fce89a70640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fce840cdaa0 0x7fce84157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.610+0000 7fce89a70640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce840c7bf0 con 0x7fce840ce4e0 2024-05-09T01:45:43.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce89a70640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce840c7ed0 con 0x7fce840ce0d0 2024-05-09T01:45:43.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce89a70640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fce840ce8f0 con 0x7fce840cdaa0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce83fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fce840ce4e0 0x7fce840ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51844/0 (socket says 172.21.15.42:51844) 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce83fff640 1 -- 172.21.15.42:0/2826263423 learned_addr learned my addr 172.21.15.42:0/2826263423 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce837fe640 1 --2- 172.21.15.42:0/2826263423 >> v2:172.21.15.181:3300/0 conn(0x7fce840cdaa0 0x7fce84157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458844957 0 0) 0x7fce840c7bf0 con 0x7fce840ce4e0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce6c003520 con 0x7fce840ce4e0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540779247 0 0) 0x7fce840c7ed0 con 0x7fce840ce0d0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce840c7bf0 con 0x7fce840ce0d0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2228140096 0 0) 0x7fce6c003520 con 0x7fce840ce4e0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 >> v2:172.21.15.181:3300/0 conn(0x7fce840cdaa0 msgr2=0x7fce84157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 --2- 172.21.15.42:0/2826263423 >> v2:172.21.15.181:3300/0 conn(0x7fce840cdaa0 0x7fce84157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 >> v1:172.21.15.181:6789/0 conn(0x7fce840ce0d0 legacy=0x7fce84160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce840c81b0 con 0x7fce840ce4e0 2024-05-09T01:45:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3383627347 0 0) 0x7fce7c001a70 con 0x7fce840ce4e0 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 >> v1:172.21.15.42:6789/0 conn(0x7fce840ce4e0 legacy=0x7fce840ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce6c003c30 0x7fce6c004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c004800 0x7fce6c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce6c005280 0x7fce6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c00c200 con 0x7fce6c005280 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c00c3b0 con 0x7fce6c003c30 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fce6c00c5b0 con 0x7fce6c004800 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce837fe640 1 --2- 172.21.15.42:0/2826263423 >> v2:172.21.15.181:3300/0 conn(0x7fce840cdaa0 0x7fce84157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.611+0000 7fce83fff640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce6c005280 0x7fce6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce82ffd640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c004800 0x7fce6c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce837fe640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce6c003c30 0x7fce6c004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce83fff640 1 -- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c004800 msgr2=0x7fce6c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce83fff640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c004800 0x7fce6c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce83fff640 1 -- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce6c003c30 msgr2=0x7fce6c004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce83fff640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce6c003c30 0x7fce6c004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce83fff640 1 -- 172.21.15.42:0/2826263423 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c003520 con 0x7fce6c005280 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.612+0000 7fce83fff640 1 -- 172.21.15.42:0/2826263423 reap_dead start 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce83fff640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce6c005280 0x7fce6c00b9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00a7a0 tx=0x7fce6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1b864cffb0a5f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00a3f0 con 0x7fce6c005280 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fce7c02f070 con 0x7fce6c005280 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce827fc640 1 -- 172.21.15.42:0/2826263423 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c02bbb0 con 0x7fce6c005280 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce89a70640 1 -- 172.21.15.42:0/2826263423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce6c005280 msgr2=0x7fce6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce89a70640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce6c005280 0x7fce6c00b9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00a7a0 tx=0x7fce6c005830 comp rx=0 tx=0).stop 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce89a70640 1 -- 172.21.15.42:0/2826263423 shutdown_connections 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce89a70640 1 --2- 172.21.15.42:0/2826263423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce6c005280 0x7fce6c00b9c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.613+0000 7fce89a70640 1 -- 172.21.15.42:0/2826263423 >> 172.21.15.42:0/2826263423 conn(0x7fce84068610 msgr2=0x7fce84068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.614+0000 7fce89a70640 1 -- 172.21.15.42:0/2826263423 shutdown_connections 2024-05-09T01:45:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.614+0000 7fce89a70640 1 -- 172.21.15.42:0/2826263423 wait complete. 2024-05-09T01:45:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.615+0000 7fce89a70640 1 Processor -- start 2024-05-09T01:45:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.615+0000 7fce89a70640 1 -- start start 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce89a70640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c005280 0x7fce8414d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce89a70640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce840b4bd0 0x7fce8415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce89a70640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 0x7fce84148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce89a70640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce840c8770 con 0x7fce8415d720 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce89a70640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fce840c79a0 con 0x7fce840b4bd0 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce89a70640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fce84160470 con 0x7fce6c005280 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 0x7fce84148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 0x7fce84148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51092/0 (socket says 172.21.15.42:51092) 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 -- 172.21.15.42:0/165649407 learned_addr learned my addr 172.21.15.42:0/165649407 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce82ffd640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce840b4bd0 0x7fce8415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce837fe640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c005280 0x7fce8414d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 -- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c005280 msgr2=0x7fce8414d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c005280 0x7fce8414d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 -- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce840b4bd0 msgr2=0x7fce8415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce840b4bd0 0x7fce8415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 -- 172.21.15.42:0/165649407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8414dea0 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce837fe640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c005280 0x7fce8414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce83fff640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 0x7fce84148ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00a8c0 tx=0x7fce840c80a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c001f60 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fce7c02bc70 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.617+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0346b0 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.618+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8414fb70 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.618+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8414ce80 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.618+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce841f4570 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.619+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce7c034850 con 0x7fce8415d720 2024-05-09T01:45:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.620+0000 7fce6bfff640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce700762d0 0x7fce700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.620+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fce7c0b7290 con 0x7fce8415d720 2024-05-09T01:45:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.620+0000 7fce837fe640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce700762d0 0x7fce700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.620+0000 7fce837fe640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce700762d0 0x7fce700787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce74009cd0 tx=0x7fce74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.624+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce7c047030 con 0x7fce8415d720 2024-05-09T01:45:43.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.855+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce840c74e0 con 0x7fce8415d720 2024-05-09T01:45:43.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.856+0000 7fce6bfff640 1 -- 172.21.15.42:0/165649407 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6912 (secure 0 0 0) 0x7fce7c080a40 con 0x7fce8415d720 2024-05-09T01:45:43.854 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:43.854 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/282699461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":282699461},{"type":"v1","addr":"172.21.15.42:6833","nonce":282699461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T01:40:59.137449+0000","modified":"2024-05-09T01:41:27.292881+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4287,"mds_2":4253,"mds_3":4247,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6837/3957323768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3957323768},{"type":"v1","addr":"172.21.15.42:6837","nonce":3957323768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4247":{"gid":4247,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6835/1600205649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1600205649},{"type":"v1","addr":"172.21.15.181:6835","nonce":1600205649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4253":{"gid":4253,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/2888840633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2888840633},{"type":"v1","addr":"172.21.15.181:6839","nonce":2888840633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.42:6835/1138022510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1138022510},{"type":"v1","addr":"172.21.15.42:6835","nonce":1138022510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/1961479918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1961479918},{"type":"v1","addr":"172.21.15.181:6837","nonce":1961479918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4241,4247,4253,4287,4311]},"id":1}]} 2024-05-09T01:45:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce700762d0 msgr2=0x7fce700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce700762d0 0x7fce700787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce74009cd0 tx=0x7fce74008040 comp rx=0 tx=0).stop 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 msgr2=0x7fce84148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 0x7fce84148ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00a8c0 tx=0x7fce840c80a0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 shutdown_connections 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fce700762d0 0x7fce700787e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8415d720 0x7fce84148ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce840b4bd0 0x7fce8415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 --2- 172.21.15.42:0/165649407 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce6c005280 0x7fce8414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 >> 172.21.15.42:0/165649407 conn(0x7fce84068610 msgr2=0x7fce84068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 shutdown_connections 2024-05-09T01:45:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.858+0000 7fce89a70640 1 -- 172.21.15.42:0/165649407 wait complete. 2024-05-09T01:45:43.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:45:43.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.984+0000 7f0d70e29640 1 Processor -- start 2024-05-09T01:45:43.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.985+0000 7f0d70e29640 1 -- start start 2024-05-09T01:45:43.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d70e29640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d6c0caf80 0x7f0d6c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d70e29640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6c160420 con 0x7f0d6c0b7ba0 2024-05-09T01:45:43.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d70e29640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6c1606e0 con 0x7f0d6c0c9500 2024-05-09T01:45:43.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d70e29640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0d6c1612f0 con 0x7f0d6c0caf80 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d69d9b640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0d6c0b7ba0 0x7f0d6c0ca870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51850/0 (socket says 172.21.15.42:51850) 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d69d9b640 1 -- 172.21.15.42:0/542380426 learned_addr learned my addr 172.21.15.42:0/542380426 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d6ad9d640 1 --2- 172.21.15.42:0/542380426 >> v2:172.21.15.181:3300/0 conn(0x7f0d6c0caf80 0x7f0d6c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d6959a640 1 -- 172.21.15.42:0/542380426 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373585040 0 0) 0x7f0d6c160420 con 0x7f0d6c0b7ba0 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.986+0000 7f0d6959a640 1 -- 172.21.15.42:0/542380426 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d58003520 con 0x7f0d6c0b7ba0 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.987+0000 7f0d6ad9d640 1 -- 172.21.15.42:0/542380426 >> v1:172.21.15.181:6789/0 conn(0x7f0d6c0c9500 legacy=0x7f0d6c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.987+0000 7f0d6959a640 1 -- 172.21.15.42:0/542380426 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673077633 0 0) 0x7f0d58003520 con 0x7f0d6c0b7ba0 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.987+0000 7f0d6ad9d640 1 -- 172.21.15.42:0/542380426 >> v1:172.21.15.42:6789/0 conn(0x7f0d6c0b7ba0 legacy=0x7f0d6c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.987+0000 7f0d6ad9d640 1 -- 172.21.15.42:0/542380426 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c1609c0 con 0x7f0d6c0caf80 2024-05-09T01:45:43.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d6ad9d640 1 --2- 172.21.15.42:0/542380426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c0ce4b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009d90 tx=0x7f0d5c02a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6f4762f3b4b8a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d6959a640 1 -- 172.21.15.42:0/542380426 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c035020 con 0x7f0d6c0caf80 2024-05-09T01:45:43.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d6959a640 1 -- 172.21.15.42:0/542380426 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0d5c007540 con 0x7f0d6c0caf80 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d6959a640 1 -- 172.21.15.42:0/542380426 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d540016f0 con 0x7f0d6c0caf80 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d70e29640 1 -- 172.21.15.42:0/542380426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 msgr2=0x7f0d6c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d70e29640 1 --2- 172.21.15.42:0/542380426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c0ce4b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009d90 tx=0x7f0d5c02a5b0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d70e29640 1 -- 172.21.15.42:0/542380426 shutdown_connections 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d70e29640 1 --2- 172.21.15.42:0/542380426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c0ce4b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.988+0000 7f0d70e29640 1 -- 172.21.15.42:0/542380426 >> 172.21.15.42:0/542380426 conn(0x7f0d6c0d2100 msgr2=0x7f0d6c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.989+0000 7f0d70e29640 1 -- 172.21.15.42:0/542380426 shutdown_connections 2024-05-09T01:45:43.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.989+0000 7f0d70e29640 1 -- 172.21.15.42:0/542380426 wait complete. 2024-05-09T01:45:43.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.990+0000 7f0d70e29640 1 Processor -- start 2024-05-09T01:45:43.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.990+0000 7f0d70e29640 1 -- start start 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d70e29640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d6c0b7ba0 0x7f0d6c15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d70e29640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 0x7f0d6c1f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d70e29640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d70e29640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c160f80 con 0x7f0d6c0c9500 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d70e29640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c0cc350 con 0x7f0d6c0caf80 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d70e29640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6c0ca190 con 0x7f0d6c0b7ba0 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 0x7f0d6c1f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 0x7f0d6c1f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51098/0 (socket says 172.21.15.42:51098) 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 -- 172.21.15.42:0/1540046841 learned_addr learned my addr 172.21.15.42:0/1540046841 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d6ad9d640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d6a59c640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d6c0b7ba0 0x7f0d6c15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 -- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d6c0b7ba0 msgr2=0x7f0d6c15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d6c0b7ba0 0x7f0d6c15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 -- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 msgr2=0x7f0d6c1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c1f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 -- 172.21.15.42:0/1540046841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c15d840 con 0x7f0d6c0c9500 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.992+0000 7f0d69d9b640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 0x7f0d6c1f4130 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400c4d0 tx=0x7f0d5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.993+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54018070 con 0x7f0d6c0c9500 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.993+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0d540074e0 con 0x7f0d6c0c9500 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.993+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6c15aaa0 con 0x7f0d6c0c9500 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.993+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54004a40 con 0x7f0d6c0c9500 2024-05-09T01:45:43.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.993+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d6c1f7dd0 con 0x7f0d6c0c9500 2024-05-09T01:45:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.994+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6c0c7360 con 0x7f0d6c0c9500 2024-05-09T01:45:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.994+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d5401b070 con 0x7f0d6c0c9500 2024-05-09T01:45:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.995+0000 7f0d62ffd640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0d4c076300 0x7f0d4c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.995+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f0d54096a50 con 0x7f0d6c0c9500 2024-05-09T01:45:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.995+0000 7f0d6a59c640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0d4c076300 0x7f0d4c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:43.996+0000 7f0d6a59c640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0d4c076300 0x7f0d4c078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000f60 tx=0x7f0d64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:43.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.000+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d5405fbb0 con 0x7f0d6c0c9500 2024-05-09T01:45:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.194+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d6c15dc70 con 0x7f0d6c0c9500 2024-05-09T01:45:44.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.195+0000 7f0d62ffd640 1 -- 172.21.15.42:0/1540046841 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16794 (secure 0 0 0) 0x7f0d54063eb0 con 0x7f0d6c0c9500 2024-05-09T01:45:44.193 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-09T01:45:44.193 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"fsid":"f3e448d1-28fc-4e6e-85c6-4e5031602bbf","created":"2024-05-09T01:40:35.797180+0000","modified":"2024-05-09T01:41:41.333745+0000","last_up_change":"2024-05-09T01:40:46.917312+0000","last_in_change":"2024-05-09T01:40:38.032315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T01:40:46.229036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T01:40:57.069565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T01:40:58.082187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cbf418ce-e7b6-4183-a201-c760dadfa132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6809","nonce":1460216605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6811","nonce":1460216605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6815","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6817","nonce":1460216605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1460216605},{"type":"v1","addr":"172.21.15.42:6813","nonce":1460216605}]},"public_addr":"172.21.15.42:6809/1460216605","cluster_addr":"172.21.15.42:6811/1460216605","heartbeat_back_addr":"172.21.15.42:6817/1460216605","heartbeat_front_addr":"172.21.15.42:6813/1460216605","state":["exists","up"]},{"osd":1,"uuid":"95921d26-b7b4-4f38-ad56-af1d5921189e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6816","nonce":1456443554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6819","nonce":1456443554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6823","nonce":1456443554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1456443554},{"type":"v1","addr":"172.21.15.42:6821","nonce":1456443554}]},"public_addr":"172.21.15.42:6816/1456443554","cluster_addr":"172.21.15.42:6819/1456443554","heartbeat_back_addr":"172.21.15.42:6823/1456443554","heartbeat_front_addr":"172.21.15.42:6821/1456443554","state":["exists","up"]},{"osd":2,"uuid":"0bca03e9-6a2a-4b3b-9d2d-9d68328573e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6825","nonce":1807965313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6827","nonce":1807965313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6831","nonce":1807965313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1807965313},{"type":"v1","addr":"172.21.15.42:6829","nonce":1807965313}]},"public_addr":"172.21.15.42:6825/1807965313","cluster_addr":"172.21.15.42:6827/1807965313","heartbeat_back_addr":"172.21.15.42:6831/1807965313","heartbeat_front_addr":"172.21.15.42:6829/1807965313","state":["exists","up"]},{"osd":3,"uuid":"53fde253-33b1-4445-ab18-50cefa42f016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6801","nonce":1948174353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6803","nonce":1948174353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6807","nonce":1948174353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1948174353},{"type":"v1","addr":"172.21.15.42:6805","nonce":1948174353}]},"public_addr":"172.21.15.42:6801/1948174353","cluster_addr":"172.21.15.42:6803/1948174353","heartbeat_back_addr":"172.21.15.42:6807/1948174353","heartbeat_front_addr":"172.21.15.42:6805/1948174353","state":["exists","up"]},{"osd":4,"uuid":"f2372e04-7e6b-40b1-bf07-e817048445d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6801","nonce":1664109051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6803","nonce":1664109051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6807","nonce":1664109051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1664109051},{"type":"v1","addr":"172.21.15.181:6805","nonce":1664109051}]},"public_addr":"172.21.15.181:6801/1664109051","cluster_addr":"172.21.15.181:6803/1664109051","heartbeat_back_addr":"172.21.15.181:6807/1664109051","heartbeat_front_addr":"172.21.15.181:6805/1664109051","state":["exists","up"]},{"osd":5,"uuid":"fdb409ac-0fdc-4e82-b65e-b5968c0daaa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6825","nonce":3826879065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6827","nonce":3826879065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6831","nonce":3826879065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3826879065},{"type":"v1","addr":"172.21.15.181:6829","nonce":3826879065}]},"public_addr":"172.21.15.181:6825/3826879065","cluster_addr":"172.21.15.181:6827/3826879065","heartbeat_back_addr":"172.21.15.181:6831/3826879065","heartbeat_front_addr":"172.21.15.181:6829/3826879065","state":["exists","up"]},{"osd":6,"uuid":"2c37ceb2-34b9-478c-a1ad-7100c6fc78d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6817","nonce":727737785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6819","nonce":727737785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6823","nonce":727737785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":727737785},{"type":"v1","addr":"172.21.15.181:6821","nonce":727737785}]},"public_addr":"172.21.15.181:6817/727737785","cluster_addr":"172.21.15.181:6819/727737785","heartbeat_back_addr":"172.21.15.181:6823/727737785","heartbeat_front_addr":"172.21.15.181:6821/727737785","state":["exists","up"]},{"osd":7,"uuid":"7490a851-8fcd-4c64-a656-af5d3d91e8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6809","nonce":3827658741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6811","nonce":3827658741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6815","nonce":3827658741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3827658741},{"type":"v1","addr":"172.21.15.181:6813","nonce":3827658741}]},"public_addr":"172.21.15.181:6809/3827658741","cluster_addr":"172.21.15.181:6811/3827658741","heartbeat_back_addr":"172.21.15.181:6815/3827658741","heartbeat_front_addr":"172.21.15.181:6813/3827658741","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.153758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.165813+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.226099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.121374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.138931+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.194694+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.242369+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T01:40:43.234269+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0d4c076300 msgr2=0x7f0d4c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0d4c076300 0x7f0d4c078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000f60 tx=0x7f0d64009040 comp rx=0 tx=0).stop 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 msgr2=0x7f0d6c1f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 0x7f0d6c1f4130 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400c4d0 tx=0x7f0d5400c990 comp rx=0 tx=0).stop 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 shutdown_connections 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f0d4c076300 0x7f0d4c078810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6c0caf80 0x7f0d6c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d6c0c9500 0x7f0d6c1f4130 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 --2- 172.21.15.42:0/1540046841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d6c0b7ba0 0x7f0d6c15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 >> 172.21.15.42:0/1540046841 conn(0x7f0d6c0d2100 msgr2=0x7f0d6c075d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:44.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 shutdown_connections 2024-05-09T01:45:44.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.198+0000 7f0d70e29640 1 -- 172.21.15.42:0/1540046841 wait complete. 2024-05-09T01:45:44.207 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T01:45:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.326+0000 7ff0bb469640 1 Processor -- start 2024-05-09T01:45:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.326+0000 7ff0bb469640 1 -- start start 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.327+0000 7ff0bb469640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b406e990 0x7ff0b4156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.327+0000 7ff0bb469640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0b40cd270 0x7ff0b40cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0bb469640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b40ce880 con 0x7ff0b40c7020 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0bb469640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b40ccb00 con 0x7ff0b40cd270 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0bb469640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b40ccde0 con 0x7ff0b406e990 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0b40cd270 0x7ff0b40cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0b40cd270 0x7ff0b40cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51106/0 (socket says 172.21.15.42:51106) 2024-05-09T01:45:44.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 -- 172.21.15.42:0/4021999930 learned_addr learned my addr 172.21.15.42:0/4021999930 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:44.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b8a04640 1 --2- 172.21.15.42:0/4021999930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b406e990 0x7ff0b4156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 -- 172.21.15.42:0/4021999930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b406e990 msgr2=0x7ff0b4156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:44.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 --2- 172.21.15.42:0/4021999930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b406e990 0x7ff0b4156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 -- 172.21.15.42:0/4021999930 >> v1:172.21.15.181:6789/0 conn(0x7ff0b40c7020 legacy=0x7ff0b406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.328+0000 7ff0b9a06640 1 -- 172.21.15.42:0/4021999930 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b415d7f0 con 0x7ff0b40cd270 2024-05-09T01:45:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.329+0000 7ff0b9a06640 1 --2- 172.21.15.42:0/4021999930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b40cd270 0x7ff0b40cd680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009870 tx=0x7ff0ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df39723cec28360 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.329+0000 7ff0b3fff640 1 -- 172.21.15.42:0/4021999930 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac037070 con 0x7ff0b40cd270 2024-05-09T01:45:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.329+0000 7ff0b3fff640 1 -- 172.21.15.42:0/4021999930 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0ac032440 con 0x7ff0b40cd270 2024-05-09T01:45:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.329+0000 7ff0b3fff640 1 -- 172.21.15.42:0/4021999930 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac032830 con 0x7ff0b40cd270 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 -- 172.21.15.42:0/4021999930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b40cd270 msgr2=0x7ff0b40cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 --2- 172.21.15.42:0/4021999930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b40cd270 0x7ff0b40cd680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009870 tx=0x7ff0ac02a1c0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 -- 172.21.15.42:0/4021999930 shutdown_connections 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 --2- 172.21.15.42:0/4021999930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b40cd270 0x7ff0b40cd680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 --2- 172.21.15.42:0/4021999930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b406e990 0x7ff0b4156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 -- 172.21.15.42:0/4021999930 >> 172.21.15.42:0/4021999930 conn(0x7ff0b4068ef0 msgr2=0x7ff0b40d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 -- 172.21.15.42:0/4021999930 shutdown_connections 2024-05-09T01:45:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.330+0000 7ff0bb469640 1 -- 172.21.15.42:0/4021999930 wait complete. 2024-05-09T01:45:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.332+0000 7ff0bb469640 1 Processor -- start 2024-05-09T01:45:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.332+0000 7ff0bb469640 1 -- start start 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0bb469640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 0x7ff0b41f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0bb469640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b40c7020 0x7ff0b4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0bb469640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b40cd270 0x7ff0b41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0bb469640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b415da90 con 0x7ff0b406e990 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0bb469640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b40ce5a0 con 0x7ff0b40cd270 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0bb469640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b40cdbc0 con 0x7ff0b40c7020 2024-05-09T01:45:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 0x7ff0b41f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 0x7ff0b41f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51108/0 (socket says 172.21.15.42:51108) 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 -- 172.21.15.42:0/3526106427 learned_addr learned my addr 172.21.15.42:0/3526106427 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9a06640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b40cd270 0x7ff0b41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b8a04640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b40c7020 0x7ff0b4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 -- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b40c7020 msgr2=0x7ff0b4151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b40c7020 0x7ff0b4151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 -- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b40cd270 msgr2=0x7ff0b41598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b40cd270 0x7ff0b41598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b9205640 1 -- 172.21.15.42:0/3526106427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b40d23b0 con 0x7ff0b406e990 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.333+0000 7ff0b8a04640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b40c7020 0x7ff0b4151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.334+0000 7ff0b9205640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 0x7ff0b41f72d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400c760 tx=0x7ff0a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.334+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4003b70 con 0x7ff0b406e990 2024-05-09T01:45:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.334+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0a4003d30 con 0x7ff0b406e990 2024-05-09T01:45:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.334+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400aa50 con 0x7ff0b406e990 2024-05-09T01:45:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.334+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b41f67f0 con 0x7ff0b406e990 2024-05-09T01:45:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.334+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b41f6db0 con 0x7ff0b406e990 2024-05-09T01:45:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.335+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b40ce250 con 0x7ff0b406e990 2024-05-09T01:45:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.336+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff0a400abf0 con 0x7ff0b406e990 2024-05-09T01:45:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.336+0000 7ff0b1ffb640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff0a0076300 0x7ff0a0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.336+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff0a4097520 con 0x7ff0b406e990 2024-05-09T01:45:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.337+0000 7ff0b8a04640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff0a0076300 0x7ff0a0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.337+0000 7ff0b8a04640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff0a0076300 0x7ff0a0078810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8006fd0 tx=0x7ff0a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:44.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.341+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff0a4060e00 con 0x7ff0b406e990 2024-05-09T01:45:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.573+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff0b406df30 con 0x7ff0b406e990 2024-05-09T01:45:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.575+0000 7ff0b1ffb640 1 -- 172.21.15.42:0/3526106427 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7ff0a4060700 con 0x7ff0b406e990 2024-05-09T01:45:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff0a0076300 msgr2=0x7ff0a0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff0a0076300 0x7ff0a0078810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8006fd0 tx=0x7ff0a8008040 comp rx=0 tx=0).stop 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 msgr2=0x7ff0b41f72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 0x7ff0b41f72d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400c760 tx=0x7ff0a400cc20 comp rx=0 tx=0).stop 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 shutdown_connections 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7ff0a0076300 0x7ff0a0078810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b40cd270 0x7ff0b41598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0b40c7020 0x7ff0b4151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 --2- 172.21.15.42:0/3526106427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0b406e990 0x7ff0b41f72d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 >> 172.21.15.42:0/3526106427 conn(0x7ff0b4068ef0 msgr2=0x7ff0b4155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.577+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 shutdown_connections 2024-05-09T01:45:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.578+0000 7ff0bb469640 1 -- 172.21.15.42:0/3526106427 wait complete. 2024-05-09T01:45:44.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T01:45:44.642 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-05-09T01:45:44.643 INFO:tasks.ceph.mds.e.smithi042.stdout:starting mds.e at 2024-05-09T01:45:44.648 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-05-09T01:45:44.654 INFO:tasks.ceph.mds.f.smithi181.stdout:starting mds.f at 2024-05-09T01:45:44.659 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-05-09T01:45:44.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.715+0000 7fe126a27640 1 Processor -- start 2024-05-09T01:45:44.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.716+0000 7fe126a27640 1 -- start start 2024-05-09T01:45:44.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe126a27640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe1200ce3f0 0x7fe120157080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe126a27640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1200cccb0 con 0x7fe1200c7660 2024-05-09T01:45:44.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe126a27640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe12006d640 con 0x7fe12015d4a0 2024-05-09T01:45:44.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe126a27640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe12006e530 con 0x7fe1200ce3f0 2024-05-09T01:45:44.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe117fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe1200c7660 0x7fe12015cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51874/0 (socket says 172.21.15.42:51874) 2024-05-09T01:45:44.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe117fff640 1 -- 172.21.15.42:0/2026136173 learned_addr learned my addr 172.21.15.42:0/2026136173 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-09T01:45:44.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe11ffff640 1 --2- 172.21.15.42:0/2026136173 >> v2:172.21.15.181:3300/0 conn(0x7fe1200ce3f0 0x7fe120157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe11f7fe640 1 -- 172.21.15.42:0/2026136173 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747033627 0 0) 0x7fe1200cccb0 con 0x7fe1200c7660 2024-05-09T01:45:44.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.717+0000 7fe11f7fe640 1 -- 172.21.15.42:0/2026136173 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe10c003520 con 0x7fe1200c7660 2024-05-09T01:45:44.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.718+0000 7fe11ffff640 1 -- 172.21.15.42:0/2026136173 >> v1:172.21.15.181:6789/0 conn(0x7fe12015d4a0 legacy=0x7fe120167710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.718+0000 7fe11ffff640 1 -- 172.21.15.42:0/2026136173 >> v1:172.21.15.42:6789/0 conn(0x7fe1200c7660 legacy=0x7fe12015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.718+0000 7fe11ffff640 1 -- 172.21.15.42:0/2026136173 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12006d920 con 0x7fe1200ce3f0 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.718+0000 7fe11ffff640 1 --2- 172.21.15.42:0/2026136173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe120157080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097a0 tx=0x7fe11002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7578327f76979818 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe11f7fe640 1 -- 172.21.15.42:0/2026136173 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110037070 con 0x7fe1200ce3f0 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe11f7fe640 1 -- 172.21.15.42:0/2026136173 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe110032640 con 0x7fe1200ce3f0 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe11f7fe640 1 -- 172.21.15.42:0/2026136173 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110032a30 con 0x7fe1200ce3f0 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 -- 172.21.15.42:0/2026136173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 msgr2=0x7fe120157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 --2- 172.21.15.42:0/2026136173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe120157080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097a0 tx=0x7fe11002a2c0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 -- 172.21.15.42:0/2026136173 shutdown_connections 2024-05-09T01:45:44.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 --2- 172.21.15.42:0/2026136173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe120157080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 -- 172.21.15.42:0/2026136173 >> 172.21.15.42:0/2026136173 conn(0x7fe120068fe0 msgr2=0x7fe1200d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:44.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 -- 172.21.15.42:0/2026136173 shutdown_connections 2024-05-09T01:45:44.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.719+0000 7fe126a27640 1 -- 172.21.15.42:0/2026136173 wait complete. 2024-05-09T01:45:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.721+0000 7fe126a27640 1 Processor -- start 2024-05-09T01:45:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.721+0000 7fe126a27640 1 -- start start 2024-05-09T01:45:44.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.722+0000 7fe126a27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 0x7fe120157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.722+0000 7fe126a27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe1201f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.722+0000 7fe126a27640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe12015d4a0 0x7fe1201f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.722+0000 7fe126a27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe12006e1c0 con 0x7fe1200c7660 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.722+0000 7fe126a27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe12006dee0 con 0x7fe1200ce3f0 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.722+0000 7fe126a27640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe12006d2e0 con 0x7fe12015d4a0 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 0x7fe120157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 0x7fe120157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51156/0 (socket says 172.21.15.42:51156) 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 -- 172.21.15.42:0/3219116734 learned_addr learned my addr 172.21.15.42:0/3219116734 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe117fff640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe1201f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe124fc4640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe12015d4a0 0x7fe1201f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 -- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe12015d4a0 msgr2=0x7fe1201f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe12015d4a0 0x7fe1201f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 -- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 msgr2=0x7fe1201f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe1201f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 -- 172.21.15.42:0/3219116734 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1201f7040 con 0x7fe1200c7660 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe124fc4640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe12015d4a0 0x7fe1201f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11ffff640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 0x7fe120157680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe110035040 tx=0x7fe1100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110037040 con 0x7fe1200c7660 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe110032440 con 0x7fe1200c7660 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1201592a0 con 0x7fe1200c7660 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100309d0 con 0x7fe1200c7660 2024-05-09T01:45:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.723+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1201f47b0 con 0x7fe1200c7660 2024-05-09T01:45:44.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.724+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1200ce1d0 con 0x7fe1200c7660 2024-05-09T01:45:44.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.725+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe110044020 con 0x7fe1200c7660 2024-05-09T01:45:44.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.725+0000 7fe11d7fa640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe1000762d0 0x7fe1000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:44.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.726+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6255+0+0 (secure 0 0 0) 0x7fe1100b7cb0 con 0x7fe1200c7660 2024-05-09T01:45:44.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.726+0000 7fe117fff640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe1000762d0 0x7fe1000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.726+0000 7fe117fff640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe1000762d0 0x7fe1000787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1200b7870 tx=0x7fe108006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.730+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe110081360 con 0x7fe1200c7660 2024-05-09T01:45:44.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:44.964+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe1201f49e0 con 0x7fe1200c7660 2024-05-09T01:45:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.577+0000 7fe11d7fa640 1 -- 172.21.15.42:0/3219116734 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fe110080c60 con 0x7fe1200c7660 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe1000762d0 msgr2=0x7fe1000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe1000762d0 0x7fe1000787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1200b7870 tx=0x7fe108006aa0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 msgr2=0x7fe120157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 0x7fe120157680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe110035040 tx=0x7fe1100046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 shutdown_connections 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fe1000762d0 0x7fe1000787e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe12015d4a0 0x7fe1201f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1200ce3f0 0x7fe1201f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 --2- 172.21.15.42:0/3219116734 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1200c7660 0x7fe120157680 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 >> 172.21.15.42:0/3219116734 conn(0x7fe120068fe0 msgr2=0x7fe1200d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 shutdown_connections 2024-05-09T01:45:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.580+0000 7fe126a27640 1 -- 172.21.15.42:0/3219116734 wait complete. 2024-05-09T01:45:45.593 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T01:45:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.725+0000 7f389b9ce640 1 Processor -- start 2024-05-09T01:45:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.725+0000 7f389b9ce640 1 -- start start 2024-05-09T01:45:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389b9ce640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f38940ca230 0x7f3894073930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389b9ce640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38940ca700 con 0x7f38941550a0 2024-05-09T01:45:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389b9ce640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3894074450 con 0x7f389415e570 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389b9ce640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f3894074730 con 0x7f38940ca230 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389976a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f38940ca230 0x7f3894073930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389976a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f38940ca230 0x7f3894073930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51168/0 (socket says 172.21.15.42:51168) 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.726+0000 7f389976a640 1 -- 172.21.15.42:0/672623371 learned_addr learned my addr 172.21.15.42:0/672623371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.727+0000 7f389976a640 1 -- 172.21.15.42:0/672623371 >> v1:172.21.15.181:6789/0 conn(0x7f389415e570 legacy=0x7f389415e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.727+0000 7f389976a640 1 -- 172.21.15.42:0/672623371 >> v1:172.21.15.42:6789/0 conn(0x7f38941550a0 legacy=0x7f38940cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.727+0000 7f389976a640 1 -- 172.21.15.42:0/672623371 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3894074a10 con 0x7f38940ca230 2024-05-09T01:45:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.727+0000 7f389976a640 1 --2- 172.21.15.42:0/672623371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38940ca230 0x7f3894073930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3890009870 tx=0x7f389002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf72ef4127d1bb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.727+0000 7f388bfff640 1 -- 172.21.15.42:0/672623371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890037070 con 0x7f38940ca230 2024-05-09T01:45:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f388bfff640 1 -- 172.21.15.42:0/672623371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f389002ae50 con 0x7f38940ca230 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f388bfff640 1 -- 172.21.15.42:0/672623371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890032880 con 0x7f38940ca230 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 -- 172.21.15.42:0/672623371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38940ca230 msgr2=0x7f3894073930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 --2- 172.21.15.42:0/672623371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38940ca230 0x7f3894073930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3890009870 tx=0x7f389002a300 comp rx=0 tx=0).stop 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 -- 172.21.15.42:0/672623371 shutdown_connections 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 --2- 172.21.15.42:0/672623371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38940ca230 0x7f3894073930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 -- 172.21.15.42:0/672623371 >> 172.21.15.42:0/672623371 conn(0x7f389406dba0 msgr2=0x7f389406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 -- 172.21.15.42:0/672623371 shutdown_connections 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.728+0000 7f389b9ce640 1 -- 172.21.15.42:0/672623371 wait complete. 2024-05-09T01:45:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.730+0000 7f389b9ce640 1 Processor -- start 2024-05-09T01:45:45.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.730+0000 7f389b9ce640 1 -- start start 2024-05-09T01:45:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f389b9ce640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38940ca230 0x7f38940c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f389b9ce640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38941550a0 0x7f38941f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f389b9ce640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 0x7f389414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f389b9ce640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3894073ff0 con 0x7f389415e570 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f389b9ce640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3894073e70 con 0x7f38941550a0 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f389b9ce640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f38940cc650 con 0x7f38940ca230 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.731+0000 7f3899f6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 0x7f389414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 0x7f389414a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51170/0 (socket says 172.21.15.42:51170) 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 -- 172.21.15.42:0/3588718164 learned_addr learned my addr 172.21.15.42:0/3588718164 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f389976a640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38940ca230 0x7f38940c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3898f69640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38941550a0 0x7f38941f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 -- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38940ca230 msgr2=0x7f38940c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38940ca230 0x7f38940c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 -- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38941550a0 msgr2=0x7f38941f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38941550a0 0x7f38941f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 -- 172.21.15.42:0/3588718164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38941f74e0 con 0x7f389415e570 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3899f6b640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 0x7f389414a540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f388c00ba10 tx=0x7f388c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c019070 con 0x7f389415e570 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f388c00cb40 con 0x7f389415e570 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38940cdc30 con 0x7f389415e570 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.732+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c014440 con 0x7f389415e570 2024-05-09T01:45:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.733+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38940cd300 con 0x7f389415e570 2024-05-09T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.733+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38940c5d40 con 0x7f389415e570 2024-05-09T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.734+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f388c01c070 con 0x7f389415e570 2024-05-09T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.735+0000 7f3889ffb640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3878076300 0x7f3878078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.735+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6255+0+0 (secure 0 0 0) 0x7f388c0974b0 con 0x7f389415e570 2024-05-09T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.735+0000 7f389976a640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3878076300 0x7f3878078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:45.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.736+0000 7f389976a640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3878076300 0x7f3878078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3890034000 tx=0x7f389002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.740+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f388c060510 con 0x7f389415e570 2024-05-09T01:45:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:45.932+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f389406d2d0 con 0x7f389415e570 2024-05-09T01:45:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.583+0000 7f3889ffb640 1 -- 172.21.15.42:0/3588718164 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f388c064810 con 0x7f389415e570 2024-05-09T01:45:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3878076300 msgr2=0x7f3878078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3878076300 0x7f3878078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3890034000 tx=0x7f389002e000 comp rx=0 tx=0).stop 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 msgr2=0x7f389414a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 0x7f389414a540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f388c00ba10 tx=0x7f388c00bed0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 shutdown_connections 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7f3878076300 0x7f3878078810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f389415e570 0x7f389414a540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38941550a0 0x7f38941f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 --2- 172.21.15.42:0/3588718164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38940ca230 0x7f38940c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 >> 172.21.15.42:0/3588718164 conn(0x7f389406dba0 msgr2=0x7f3894152950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:46.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 shutdown_connections 2024-05-09T01:45:46.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.587+0000 7f389b9ce640 1 -- 172.21.15.42:0/3588718164 wait complete. 2024-05-09T01:45:46.599 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T01:45:46.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.727+0000 7fea77134640 1 Processor -- start 2024-05-09T01:45:46.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.727+0000 7fea77134640 1 -- start start 2024-05-09T01:45:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea77134640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fea700c7780 0x7fea700cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea77134640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fea700b4e90 0x7fea7006d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea77134640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea7015cf90 con 0x7fea7006dba0 2024-05-09T01:45:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea77134640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fea700ce890 con 0x7fea700c7780 2024-05-09T01:45:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea77134640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fea700ccbc0 con 0x7fea700b4e90 2024-05-09T01:45:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fea700c7780 0x7fea700cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fea700c7780 0x7fea700cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51178/0 (socket says 172.21.15.42:51178) 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 -- 172.21.15.42:0/3295413166 learned_addr learned my addr 172.21.15.42:0/3295413166 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea6ffff640 1 --2- 172.21.15.42:0/3295413166 >> v2:172.21.15.181:3300/0 conn(0x7fea700b4e90 0x7fea7006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 -- 172.21.15.42:0/3295413166 >> v2:172.21.15.181:3300/0 conn(0x7fea700b4e90 msgr2=0x7fea7006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 --2- 172.21.15.42:0/3295413166 >> v2:172.21.15.181:3300/0 conn(0x7fea700b4e90 0x7fea7006d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 -- 172.21.15.42:0/3295413166 >> v1:172.21.15.42:6789/0 conn(0x7fea7006dba0 legacy=0x7fea70160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.729+0000 7fea74ed0640 1 -- 172.21.15.42:0/3295413166 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea700cce10 con 0x7fea700c7780 2024-05-09T01:45:46.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.730+0000 7fea74ed0640 1 --2- 172.21.15.42:0/3295413166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea700c7780 0x7fea700cd8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fea700d2b80 tx=0x7fea6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343df6964f1903e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:46.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.730+0000 7fea6f7fe640 1 -- 172.21.15.42:0/3295413166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60037070 con 0x7fea700c7780 2024-05-09T01:45:46.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.730+0000 7fea6f7fe640 1 -- 172.21.15.42:0/3295413166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea60032440 con 0x7fea700c7780 2024-05-09T01:45:46.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.730+0000 7fea6f7fe640 1 -- 172.21.15.42:0/3295413166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60032830 con 0x7fea700c7780 2024-05-09T01:45:46.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 -- 172.21.15.42:0/3295413166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea700c7780 msgr2=0x7fea700cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:46.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 --2- 172.21.15.42:0/3295413166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea700c7780 0x7fea700cd8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fea700d2b80 tx=0x7fea6002a1e0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 -- 172.21.15.42:0/3295413166 shutdown_connections 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 --2- 172.21.15.42:0/3295413166 >> v2:172.21.15.181:3300/0 conn(0x7fea700b4e90 0x7fea7006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 --2- 172.21.15.42:0/3295413166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea700c7780 0x7fea700cd8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 -- 172.21.15.42:0/3295413166 >> 172.21.15.42:0/3295413166 conn(0x7fea70068e00 msgr2=0x7fea700d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 -- 172.21.15.42:0/3295413166 shutdown_connections 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.731+0000 7fea77134640 1 -- 172.21.15.42:0/3295413166 wait complete. 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.733+0000 7fea77134640 1 Processor -- start 2024-05-09T01:45:46.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.733+0000 7fea77134640 1 -- start start 2024-05-09T01:45:46.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea77134640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 0x7fea700d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:46.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea77134640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea700b4e90 0x7fea7014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:46.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea77134640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea700c7780 0x7fea701e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:46.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea77134640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea700ce530 con 0x7fea7006dba0 2024-05-09T01:45:46.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea77134640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fea700cd460 con 0x7fea700c7780 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea77134640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fea70157350 con 0x7fea700b4e90 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea74ed0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 0x7fea700d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea74ed0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 0x7fea700d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51184/0 (socket says 172.21.15.42:51184) 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.734+0000 7fea74ed0640 1 -- 172.21.15.42:0/1181059899 learned_addr learned my addr 172.21.15.42:0/1181059899 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea756d1640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea700c7780 0x7fea701e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea6ffff640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea700b4e90 0x7fea7014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea74ed0640 1 -- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea700b4e90 msgr2=0x7fea7014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea74ed0640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea700b4e90 0x7fea7014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea74ed0640 1 -- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea700c7780 msgr2=0x7fea701e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea74ed0640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea700c7780 0x7fea701e6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea74ed0640 1 -- 172.21.15.42:0/1181059899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7015ccc0 con 0x7fea7006dba0 2024-05-09T01:45:46.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea756d1640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea700c7780 0x7fea701e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea74ed0640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 0x7fea700d0370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fea60000c00 tx=0x7fea600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60037040 con 0x7fea7006dba0 2024-05-09T01:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea60042070 con 0x7fea7006dba0 2024-05-09T01:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea700d08b0 con 0x7fea7006dba0 2024-05-09T01:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60030bf0 con 0x7fea7006dba0 2024-05-09T01:45:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.735+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7015c700 con 0x7fea7006dba0 2024-05-09T01:45:46.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.736+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea700ce310 con 0x7fea7006dba0 2024-05-09T01:45:46.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.737+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea60047460 con 0x7fea7006dba0 2024-05-09T01:45:46.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.737+0000 7fea6d7fa640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea500762d0 0x7fea500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:45:46.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.737+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5817+0+0 (secure 0 0 0) 0x7fea600b8480 con 0x7fea7006dba0 2024-05-09T01:45:46.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.738+0000 7fea6ffff640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea500762d0 0x7fea500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:45:46.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.738+0000 7fea6ffff640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea500762d0 0x7fea500787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea58006fd0 tx=0x7fea58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:45:46.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.742+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea60032e20 con 0x7fea7006dba0 2024-05-09T01:45:46.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:46.939+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea700cea30 con 0x7fea7006dba0 2024-05-09T01:45:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.585+0000 7fea6d7fa640 1 -- 172.21.15.42:0/1181059899 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fea600815f0 con 0x7fea7006dba0 2024-05-09T01:45:47.583 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-05-09T01:45:47.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.587+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea500762d0 msgr2=0x7fea500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.587+0000 7fea77134640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea500762d0 0x7fea500787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea58006fd0 tx=0x7fea58008040 comp rx=0 tx=0).stop 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.587+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 msgr2=0x7fea700d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 0x7fea700d0370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fea60000c00 tx=0x7fea600046c0 comp rx=0 tx=0).stop 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 shutdown_connections 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:6832/112467660,v1:172.21.15.181:6833/112467660] conn(0x7fea500762d0 0x7fea500787e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea700c7780 0x7fea701e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea700b4e90 0x7fea7014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 --2- 172.21.15.42:0/1181059899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea7006dba0 0x7fea700d0370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 >> 172.21.15.42:0/1181059899 conn(0x7fea70068e00 msgr2=0x7fea7014d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 shutdown_connections 2024-05-09T01:45:47.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-09T01:45:47.588+0000 7fea77134640 1 -- 172.21.15.42:0/1181059899 wait complete. 2024-05-09T01:45:47.607 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T01:45:47.607 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T01:45:47.607 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.622 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T01:45:47.622 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T01:45:47.622 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.673 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T01:45:47.673 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-09T01:45:47.674 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.728 INFO:tasks.ceph.mds.e:Stopped 2024-05-09T01:45:47.728 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T01:45:47.728 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.741 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T01:45:47.742 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T01:45:47.742 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.794 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T01:45:47.795 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-09T01:45:47.795 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.847 INFO:tasks.ceph.mds.f:Stopped 2024-05-09T01:45:47.847 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T01:45:47.848 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T01:45:47.848 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.880 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T01:45:47.880 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T01:45:47.880 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:47.949 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T01:45:47.949 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T01:45:47.949 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.029 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T01:45:48.029 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T01:45:48.029 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.100 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T01:45:48.100 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T01:45:48.100 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.135 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T01:45:48.136 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T01:45:48.136 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.206 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T01:45:48.206 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T01:45:48.206 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.276 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T01:45:48.277 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T01:45:48.277 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.348 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T01:45:48.348 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T01:45:48.349 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T01:45:48.349 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.379 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T01:45:48.379 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T01:45:48.379 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.418 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T01:45:48.418 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T01:45:48.418 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T01:45:48.418 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.434 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T01:45:48.434 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T01:45:48.434 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.473 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T01:45:48.473 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T01:45:48.473 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T01:45:48.522 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T01:45:48.523 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T01:45:48.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-09T01:45:48.577 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:45:48.577 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T01:45:48.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:45:48.776 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T01:45:48.870 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:45:48.870 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T01:45:48.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:45:48.944 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T01:45:49.002 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:45:49.002 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T01:45:49.217 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:45:49.217 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T01:45:49.280 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:45:49.280 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T01:45:49.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:45:49.337 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T01:45:49.408 INFO:tasks.ceph:Archiving mon data... 2024-05-09T01:45:49.409 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/data/mon.a.tgz 2024-05-09T01:45:49.410 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-09T01:45:49.429 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.c1A0GA81Ts 2024-05-09T01:45:49.429 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.c1A0GA81Ts 2024-05-09T01:45:49.573 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.c1A0GA81Ts 2024-05-09T01:45:49.661 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.c1A0GA81Ts is 318KB 2024-05-09T01:45:49.730 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.c1A0GA81Ts 2024-05-09T01:45:49.746 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/data/mon.b.tgz 2024-05-09T01:45:49.747 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-05-09T01:45:49.762 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.7FrUoU6Zi1 2024-05-09T01:45:49.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7FrUoU6Zi1 2024-05-09T01:45:49.924 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.7FrUoU6Zi1 2024-05-09T01:45:50.007 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.7FrUoU6Zi1 is 425KB 2024-05-09T01:45:50.076 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.7FrUoU6Zi1 2024-05-09T01:45:50.091 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/data/mon.c.tgz 2024-05-09T01:45:50.091 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-05-09T01:45:50.146 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.qbEBxAFKCA 2024-05-09T01:45:50.146 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qbEBxAFKCA 2024-05-09T01:45:50.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.qbEBxAFKCA 2024-05-09T01:45:50.376 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.qbEBxAFKCA is 425KB 2024-05-09T01:45:50.471 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.qbEBxAFKCA 2024-05-09T01:45:50.485 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T01:45:50.485 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T01:45:50.488 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T01:45:50.576 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T01:45:50.605 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T01:45:50.605 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T01:45:50.607 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/remote/smithi042/crash 2024-05-09T01:45:50.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T01:45:50.645 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/remote/smithi181/crash 2024-05-09T01:45:50.646 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T01:45:50.670 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T01:45:50.670 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:50.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:50.758 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:50.785 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T01:45:50.809 INFO:tasks.ceph:Compressing logs... 2024-05-09T01:45:50.810 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T01:45:50.828 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T01:45:50.852 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41819.log 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35609.log 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35344.log 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35609.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.41815.log -- replaced with /var/log/ceph/ceph-client.admin.41819.log.gz 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35609.log.gz 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46475.log 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35344.log.gz 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2024-05-09T01:45:50.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42408.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46805.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46475.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44274.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43900.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42408.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40224.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45424.log 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43900.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2024-05-09T01:45:50.877 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.40224.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45424.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40224.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45424.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45225.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.41146.log: --verbose -- /var/log/ceph/ceph-client.admin.45827.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45225.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45225.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41701.log 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45827.log: /var/log/ceph/ceph-osd.2.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45827.log.gz 2024-05-09T01:45:50.878 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46847.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41701.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40308.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4%/var/log/ceph/ceph-client.admin.46847.log: -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46847.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45605.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45605.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41148.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45605.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2024-05-09T01:45:50.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35712.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6%/var/log/ceph/ceph-client.admin.45083.log: -- replaced with /var/log/ceph/ceph-client.admin.41148.log.gz 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41820.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz -- replaced with /var/log/ceph/ceph-client.admin.35712.log.gz 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41144.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41820.log.gz 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41144.log.gz 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40666.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44413.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T01:45:50.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44099.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40666.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41822.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41150.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41822.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44099.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40716.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42862.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41150.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40716.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40716.log.gz 2024-05-09T01:45:50.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46289.log: /var/log/ceph/ceph-client.admin.46725.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46331.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40968.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2024-05-09T01:45:50.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43966.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40968.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41702.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41702.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40522.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2%/var/log/ceph/ceph-client.admin.40522.log: -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40884.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40522.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44479.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45268.log: /var/log/ceph/ceph-client.admin.40884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44479.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40884.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44479.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2024-05-09T01:45:50.883 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.46557.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41145.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42450.log 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42103.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-05-09T01:45:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35954.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35954.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.f.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35954.log.gz 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T01:45:50.893 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T01:45:50.894 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2024-05-09T01:45:50.897 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35743.log 2024-05-09T01:45:50.905 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35874.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2024-05-09T01:45:50.905 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35663.log 2024-05-09T01:45:50.914 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46683.log 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42366.log: -- replaced with /var/log/ceph/ceph-client.admin.42450.log.gz 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45563.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40842.log 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose --/var/log/ceph/ceph-client.admin.46683.log: /var/log/ceph/ceph-client.admin.41478.log 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40842.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46683.log.gz 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40396.log 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40842.log.gz 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41478.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41478.log.gz 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2024-05-09T01:45:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-mon.a.log: -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40396.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45869.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46415.log: /var/log/ceph/ceph-client.admin.46373.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45869.log: /var/log/ceph/ceph-client.admin.46037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40438.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44611.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45869.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2024-05-09T01:45:50.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40438.log.gz 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44165.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44522.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44165.log: /var/log/ceph/ceph-client.admin.46121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44522.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44165.log.gz 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44522.log.gz 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42577.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29328.log 2024-05-09T01:45:50.917 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41484.log 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.tmp-client.admin.29328.log: /var/log/ceph/ceph-client.admin.42964.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29328.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40352.log 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41484.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40352.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41484.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40352.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40624.log 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46599.log: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43740.log 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2024-05-09T01:45:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40480.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40624.log: /var/log/ceph/ceph-client.admin.43740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40480.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40624.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40480.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44654.log: /var/log/ceph/ceph-client.admin.46247.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46247.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41149.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42493.log: /var/log/ceph/ceph-client.admin.46641.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-05-09T01:45:50.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41149.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41149.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41486.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41479.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43698.log: /var/log/ceph/ceph-client.admin.41486.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41486.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41479.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41479.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40582.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46515.log: /var/log/ceph/ceph-client.admin.44032.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46079.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0%/var/log/ceph/ceph-client.admin.40582.log: -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40582.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41821.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42796.log 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46079.log: /var/log/ceph/ceph-client.admin.41821.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46079.log.gz 2024-05-09T01:45:50.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39926.log 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41821.log.gz 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42796.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42796.log.gz 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46163.log 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43375.log 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39926.log: /var/log/ceph/ceph-client.admin.46163.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39926.log.gz 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41483.log 2024-05-09T01:45:50.921 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46163.log.gz 2024-05-09T01:45:50.924 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35743.log: 87.6% 91.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-09T01:45:50.924 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35743.log.gz 2024-05-09T01:45:50.924 INFO:teuthology.orchestra.run.smithi181.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T01:45:50.924 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35914.log 2024-05-09T01:45:50.924 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35703.log 2024-05-09T01:45:50.924 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35914.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35663.log.gz 2024-05-09T01:45:50.925 INFO:teuthology.orchestra.run.smithi181.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35914.log.gz 2024-05-09T01:45:50.925 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35787.log 2024-05-09T01:45:50.925 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35703.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-09T01:45:50.925 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.35787.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35703.log.gz 2024-05-09T01:45:50.925 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35787.log.gz 2024-05-09T01:45:50.925 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T01:45:50.928 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.43375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44956.log 2024-05-09T01:45:50.928 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41483.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41483.log.gz 2024-05-09T01:45:50.928 INFO:teuthology.orchestra.run.smithi042.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-09T01:45:50.928 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40926.log 2024-05-09T01:45:50.928 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40800.log 2024-05-09T01:45:50.928 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40926.log: 89.3% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44956.log.gz 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40926.log.gz 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40122.log 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40122.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40800.log.gz 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40122.log.gz 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42282.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2024-05-09T01:45:50.929 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45953.log 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45953.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45953.log.gz 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42019.log 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40266.log 2024-05-09T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42019.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42019.log.gz 2024-05-09T01:45:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45995.log 2024-05-09T01:45:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40266.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40266.log.gz 2024-05-09T01:45:50.945 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T01:45:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2024-05-09T01:45:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45995.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2024-05-09T01:45:50.966 INFO:teuthology.orchestra.run.smithi042.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T01:45:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42730.log 2024-05-09T01:45:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-05-09T01:45:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42730.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2024-05-09T01:45:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45785.log 2024-05-09T01:45:50.969 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9%/var/log/ceph/ceph-client.admin.40007.log: -- replaced with /var/log/ceph/ceph-client.admin.42730.log.gz 2024-05-09T01:45:50.969 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-05-09T01:45:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-05-09T01:45:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-05-09T01:45:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42535.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2024-05-09T01:45:50.971 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42145.log 2024-05-09T01:45:50.971 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-05-09T01:45:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46205.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-05-09T01:45:50.973 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44912.log 2024-05-09T01:45:50.973 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2024-05-09T01:45:50.973 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44912.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42145.log.gz 2024-05-09T01:45:50.973 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2024-05-09T01:45:50.973 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44912.log.gz 2024-05-09T01:45:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43530.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2024-05-09T01:45:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41481.log 2024-05-09T01:45:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42190.log 2024-05-09T01:45:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41481.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2024-05-09T01:45:50.975 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41481.log.gz 2024-05-09T01:45:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42190.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42190.log.gz 2024-05-09T01:45:51.024 INFO:teuthology.orchestra.run.smithi181.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T01:45:51.048 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T01:45:51.105 INFO:teuthology.orchestra.run.smithi042.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T01:45:51.108 INFO:teuthology.orchestra.run.smithi181.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-09T01:45:51.331 INFO:teuthology.orchestra.run.smithi181.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T01:45:51.337 INFO:teuthology.orchestra.run.smithi042.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T01:45:51.339 INFO:teuthology.orchestra.run.smithi181.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T01:45:51.397 INFO:teuthology.orchestra.run.smithi042.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T01:45:51.492 INFO:teuthology.orchestra.run.smithi042.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T01:45:51.514 INFO:teuthology.orchestra.run.smithi042.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T01:45:51.541 INFO:teuthology.orchestra.run.smithi181.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T01:45:51.548 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T01:45:51.551 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-05-09T01:45:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m0.685s 2024-05-09T01:45:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m2.754s 2024-05-09T01:45:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.125s 2024-05-09T01:45:58.823 INFO:teuthology.orchestra.run.smithi042.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.0.43375.log.gz 2024-05-09T01:45:58.825 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-09T01:45:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m7.984s 2024-05-09T01:45:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m10.219s 2024-05-09T01:45:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.438s 2024-05-09T01:45:58.825 INFO:tasks.ceph:Archiving logs... 2024-05-09T01:45:58.826 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/remote/smithi042/log 2024-05-09T01:45:58.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T01:46:00.063 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/remote/smithi181/log 2024-05-09T01:46:00.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T01:46:00.482 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T01:46:00.491 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T01:46:00.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T01:46:00.494 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T01:46:00.576 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T01:46:00.586 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T01:46:00.586 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:46:00.589 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:46:00.604 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:46:00.605 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:46:00.609 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:46:00.609 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-05-09T01:46:00.609 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +2231us[+2781us] +/- 41ms 2024-05-09T01:46:00.609 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -2506us[-1955us] +/- 78ms 2024-05-09T01:46:00.609 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -1310us[-1310us] +/- 79ms 2024-05-09T01:46:00.609 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:46:00.611 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:46:00.611 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-05-09T01:46:00.611 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +2170us[+2515us] +/- 41ms 2024-05-09T01:46:00.611 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -2581us[-2237us] +/- 78ms 2024-05-09T01:46:00.611 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1380us[-1035us] +/- 79ms 2024-05-09T01:46:00.611 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:46:00.612 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T01:46:00.623 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T01:46:00.624 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T01:46:00.701 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T01:46:00.774 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T01:46:00.836 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:46:00.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:46:00.870 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:46:00.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:46:00.901 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T01:46:00.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T01:46:00.949 INFO:teuthology.task.internal:Duration was 971.411182 seconds 2024-05-09T01:46:00.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T01:46:00.969 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T01:46:00.969 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T01:46:00.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T01:46:01.011 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:46:01.014 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:46:01.221 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T01:46:01.221 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-05-09T01:46:01.221 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T01:46:01.245 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-05-09T01:46:01.246 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T01:46:01.287 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T01:46:01.287 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T01:46:01.289 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T01:46:01.354 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T01:46:01.354 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T01:46:01.359 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T01:46:01.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T01:46:01.505 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T01:46:01.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T01:46:01.533 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T01:46:01.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T01:46:01.573 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:46:01.576 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:46:01.598 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-05-09T01:46:01.621 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-05-09T01:46:01.642 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:46:01.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:46:01.667 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:46:01.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:46:01.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T01:46:01.708 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T01:46:01.709 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/remote/smithi042 2024-05-09T01:46:01.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T01:46:01.744 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698957/remote/smithi181 2024-05-09T01:46:01.744 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T01:46:01.777 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T01:46:01.778 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T01:46:01.781 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T01:46:01.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T01:46:01.839 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T01:46:01.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T01:46:01.893 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T01:46:01.893 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T01:46:01.896 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T01:46:01.909 INFO:teuthology.orchestra.run.smithi042.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 01:46 /home/ubuntu/cephtest 2024-05-09T01:46:01.911 INFO:teuthology.orchestra.run.smithi181.stdout: 265809 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 01:46 /home/ubuntu/cephtest 2024-05-09T01:46:01.912 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T01:46:01.925 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T01:46:01.959 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 971.4111819267273 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T01:46:01.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T01:46:02.046 INFO:teuthology.run:pass